Jun 03 20:40:08.865812 ip-10-0-130-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 20:40:08.865827 ip-10-0-130-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 20:40:08.865837 ip-10-0-130-87 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 20:40:08.866052 ip-10-0-130-87 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 20:40:19.068398 ip-10-0-130-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 20:40:19.068418 ip-10-0-130-87 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3390c2fb11104f7da68f024887b1c021 -- Jun 03 20:42:32.660544 ip-10-0-130-87 systemd[1]: Starting Kubernetes Kubelet... Jun 03 20:42:33.072673 ip-10-0-130-87 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:42:33.072673 ip-10-0-130-87 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 20:42:33.072673 ip-10-0-130-87 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:42:33.072673 ip-10-0-130-87 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 20:42:33.072673 ip-10-0-130-87 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:42:33.073709 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.073604 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 20:42:33.077439 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077423 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:33.077439 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077438 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077442 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077446 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077449 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077452 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077455 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077458 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077462 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077466 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077471 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077474 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077477 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077480 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077483 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077486 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077489 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077491 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077494 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077497 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077499 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:33.077500 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077502 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077505 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077508 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077511 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077514 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077516 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077519 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077521 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077524 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077527 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077529 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077532 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077535 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077537 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077541 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077545 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077548 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077552 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077556 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:33.077973 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077559 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077562 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077565 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077567 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077570 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077572 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077575 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077577 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077580 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077582 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077585 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077587 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077590 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077592 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077595 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077598 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077601 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077603 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077606 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077609 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:33.078450 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077612 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077614 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077617 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077619 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077622 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077624 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077627 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077630 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077632 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077636 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077639 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077642 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077644 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077647 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077650 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077652 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077655 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077657 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077660 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:33.078954 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077663 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077665 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077667 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077670 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077674 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077677 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077679 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077682 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077686 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077689 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077692 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077694 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077697 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077699 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077702 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077705 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077707 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077710 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:33.079420 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.077712 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:33.081355 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081338 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:33.081355 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081354 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:33.081355 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081358 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081361 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081364 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081368 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081371 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081374 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081378 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081381 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081383 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081386 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081389 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081391 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081394 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081396 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081399 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081402 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081404 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081407 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081410 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081412 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:33.081475 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081415 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081417 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081420 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081422 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081426 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081429 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081431 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081434 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081436 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081439 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081442 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081444 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081447 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081449 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081453 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081456 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081458 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081461 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081464 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:33.081971 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081466 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081469 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081471 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081476 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081480 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081483 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081486 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081489 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081492 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081495 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081497 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081500 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081503 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081506 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081509 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081512 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081515 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081518 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081520 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081523 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:33.082449 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081525 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081528 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081530 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081533 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081537 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081540 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081542 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081545 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081549 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081551 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081554 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081556 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081559 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081561 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081564 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081567 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081570 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081575 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081577 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:33.082937 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081580 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081582 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081585 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081588 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081591 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081594 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081597 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081601 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081603 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081606 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081609 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081611 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081613 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081616 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081619 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081621 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081624 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081627 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081986 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:33.083411 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081991 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081995 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.081998 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082001 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082003 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082006 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082009 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082012 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082015 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082017 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082020 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082022 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082025 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082027 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082030 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082032 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082035 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082038 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082040 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:33.083866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082043 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082045 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082048 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082050 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082053 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082055 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082058 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082061 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082063 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082066 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082069 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082072 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082074 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082077 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082080 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082083 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082085 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082088 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082090 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:33.084353 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082092 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082095 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082097 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082100 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082103 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082105 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082108 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082111 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082113 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082116 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082118 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082121 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082123 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082126 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082128 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082131 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082134 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082137 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082139 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082142 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:33.084803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082145 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082148 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082151 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082153 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082155 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082158 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082160 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082163 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082165 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082168 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082170 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082173 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082175 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082178 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082180 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082183 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082185 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082187 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082190 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082193 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:33.085350 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082195 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082197 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082200 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082202 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082205 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082208 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082210 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082214 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082216 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082219 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082221 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082227 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082231 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082236 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082240 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082243 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082246 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082249 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082252 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082335 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 20:42:33.085826 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082342 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082348 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082358 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082364 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082369 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082373 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082377 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082380 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082383 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082386 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082390 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082393 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082396 2560 flags.go:64] FLAG: --cgroup-root="" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082399 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082402 2560 flags.go:64] FLAG: --client-ca-file="" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082404 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082407 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082413 2560 flags.go:64] FLAG: --cluster-domain="" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082416 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082419 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082422 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082426 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082429 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 20:42:33.086318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082434 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082438 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082441 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082444 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082447 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082450 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082453 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082456 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082460 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082463 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082466 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082469 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082472 2560 flags.go:64] FLAG: --enable-server="true" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082475 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082479 2560 flags.go:64] FLAG: --event-burst="100" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082482 2560 flags.go:64] FLAG: --event-qps="50" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082485 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082488 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082491 2560 flags.go:64] FLAG: --eviction-hard="" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082494 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082497 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082500 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082503 2560 flags.go:64] FLAG: --eviction-soft="" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082506 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082509 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 20:42:33.086863 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082511 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082514 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082520 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082523 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082526 2560 flags.go:64] FLAG: --feature-gates="" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082529 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082532 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082536 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082540 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082543 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082546 2560 flags.go:64] FLAG: --help="false" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082549 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082552 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082555 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082558 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082561 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082564 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082567 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082570 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082573 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082575 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082578 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082581 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082584 2560 flags.go:64] FLAG: --kube-reserved="" Jun 03 20:42:33.087483 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082587 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082589 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082593 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082596 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082599 2560 flags.go:64] FLAG: --lock-file="" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082601 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082604 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082607 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082612 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082615 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082618 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082622 2560 flags.go:64] FLAG: --logging-format="text" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082625 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082628 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082630 2560 flags.go:64] FLAG: --manifest-url="" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082639 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082643 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082646 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082650 2560 flags.go:64] FLAG: --max-pods="110" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082653 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082656 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082659 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082661 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082664 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082667 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 20:42:33.088128 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082670 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082676 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082679 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082682 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082685 2560 flags.go:64] FLAG: --pod-cidr="" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082688 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082694 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082696 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082699 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082702 2560 flags.go:64] FLAG: --port="10250" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082705 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082708 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d8cdbb234532a792" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082711 2560 flags.go:64] FLAG: --qos-reserved="" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082714 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082717 2560 flags.go:64] FLAG: --register-node="true" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082720 2560 flags.go:64] FLAG: --register-with-taints="" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082723 2560 flags.go:64] FLAG: --registry-burst="10" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082726 2560 flags.go:64] FLAG: --registry-qps="5" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082729 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082732 2560 flags.go:64] FLAG: --reserved-memory="" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082735 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082738 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082742 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082746 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082749 2560 flags.go:64] FLAG: --runonce="false" Jun 03 20:42:33.088786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082752 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082755 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082758 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082761 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082764 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082767 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082770 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082773 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082776 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082778 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082781 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082784 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082787 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082790 2560 flags.go:64] FLAG: --system-cgroups="" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082793 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082798 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082801 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082803 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082807 2560 flags.go:64] FLAG: --tls-min-version="" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082810 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082813 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082816 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082819 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082821 2560 flags.go:64] FLAG: --v="2" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082825 2560 flags.go:64] FLAG: --version="false" Jun 03 20:42:33.089408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082829 2560 flags.go:64] FLAG: --vmodule="" Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082832 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.082836 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082946 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082951 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082955 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082958 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082961 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082965 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082968 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082970 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082973 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082975 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082978 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082982 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082986 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082989 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082992 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082995 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:33.090009 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.082997 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083000 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083003 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083005 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083008 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083011 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083013 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083016 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083018 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083021 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083024 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083026 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083029 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083032 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083034 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083037 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083040 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083042 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083047 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083049 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:33.090481 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083052 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083055 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083058 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083060 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083063 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083065 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083068 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083071 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083073 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083076 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083078 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083081 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083084 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083086 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083089 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083091 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083094 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083096 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083099 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083102 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:33.091048 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083104 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083107 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083109 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083112 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083114 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083117 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083119 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083123 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083127 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083130 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083134 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083137 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083140 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083142 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083145 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083147 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083150 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083153 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083155 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083158 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:33.091563 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083160 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083163 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083165 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083167 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083170 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083173 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083175 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083178 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083181 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083183 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083187 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083190 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083193 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083196 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083199 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083217 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083221 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083224 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083227 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:33.092051 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083230 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083232 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.083235 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.083817 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090101 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090116 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090136 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090141 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090194 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090198 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090201 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090204 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090207 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090210 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090212 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:33.092569 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090216 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090218 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090223 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090227 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090231 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090234 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090237 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090240 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090243 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090246 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090249 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090252 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090268 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090272 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090274 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090277 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090280 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090282 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090285 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:33.092951 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090289 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090291 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090295 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090299 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090301 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090304 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090306 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090309 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090311 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090314 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090316 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090319 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090321 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090324 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090327 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090329 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090332 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090335 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090337 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090340 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:33.093433 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090342 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090345 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090347 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090350 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090352 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090355 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090357 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090360 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090362 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090365 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090367 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090371 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090375 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090378 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090380 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090383 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090386 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090388 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090391 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:33.093915 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090395 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090399 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090402 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090405 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090408 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090411 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090413 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090416 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090419 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090421 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090424 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090427 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090429 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090431 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090434 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090437 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090439 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090442 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090444 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090447 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:33.094391 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090449 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090452 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090454 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090457 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090459 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090462 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090465 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090467 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090470 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090472 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090475 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090478 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090480 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090485 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090592 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:42:33.094866 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090596 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090599 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090602 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090605 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090607 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090610 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090613 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090615 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090618 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090620 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090623 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090625 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090628 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090630 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090633 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090635 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090638 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090641 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090643 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090646 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:42:33.095232 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090648 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090651 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090654 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090656 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090659 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090661 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090664 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090666 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090669 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090672 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090674 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090677 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090679 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090682 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090684 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090687 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090689 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090692 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090695 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:42:33.095723 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090698 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090700 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090703 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090705 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090708 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090710 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090713 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090715 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090718 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090722 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090725 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090728 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090731 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090734 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090737 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090739 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090742 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090744 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090747 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090749 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:42:33.096192 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090752 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090754 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090757 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090760 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090762 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090765 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090767 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090771 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090774 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090778 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090780 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090783 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090785 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090788 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090791 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090793 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090795 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090798 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090800 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:42:33.096741 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090805 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090808 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090810 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090813 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090816 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090818 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090821 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090823 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090826 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090828 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090831 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090833 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090836 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090838 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090841 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090843 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090846 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090849 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:42:33.097217 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:33.090851 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090856 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.090971 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.092865 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.094282 2560 server.go:1019] "Starting client certificate rotation" Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.094380 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.094414 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:42:33.097656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.096841 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:42:33.098063 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.098044 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:42:33.107771 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.107756 2560 log.go:25] "Validated CRI v1 runtime API" Jun 03 20:42:33.111834 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.111818 2560 log.go:25] "Validated CRI v1 image API" Jun 03 20:42:33.112559 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.112544 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 20:42:33.115789 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.115771 2560 fs.go:135] Filesystem UUIDs: map[3c732794-d78b-4568-9c09-460bdcd592e8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c81cce4b-e533-4730-91d3-8d5018b7c2a3:/dev/nvme0n1p4] Jun 03 20:42:33.115858 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.115788 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 20:42:33.120706 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.120601 2560 manager.go:216] Machine: {Timestamp:2026-06-03 20:42:33.119290806 +0000 UTC m=+0.328604017 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3140121 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec217006ad3f8ef3404c8a7e59eee149 SystemUUID:ec217006-ad3f-8ef3-404c-8a7e59eee149 BootID:3390c2fb-1110-4f7d-a68f-024887b1c021 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a6:be:07:f5:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a6:be:07:f5:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:4c:8d:1a:ac:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 20:42:33.120706 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.120704 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 20:42:33.120812 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.120777 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 20:42:33.123567 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.123540 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 20:42:33.123692 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.123570 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 20:42:33.124770 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.124760 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 20:42:33.124804 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.124773 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 20:42:33.124804 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.124781 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:42:33.125293 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.125278 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:42:33.125474 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.125464 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:42:33.126300 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.126290 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 20:42:33.129275 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129252 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:42:33.129406 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129397 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 20:42:33.129450 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129441 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 03 20:42:33.129481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129452 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 20:42:33.129481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129466 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 20:42:33.129481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129475 2560 kubelet.go:398] "Adding apiserver pod source" Jun 03 20:42:33.129606 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129484 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 20:42:33.129809 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129790 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:42:33.129809 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.129809 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:42:33.131972 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.131958 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 20:42:33.133599 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.133585 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 20:42:33.133677 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.133615 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 20:42:33.134709 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134698 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 20:42:33.134748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134713 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 20:42:33.134748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134719 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 20:42:33.134748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134724 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 20:42:33.134748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134733 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 20:42:33.134748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134739 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 20:42:33.134748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134748 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 20:42:33.134904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134753 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 20:42:33.134904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134760 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 20:42:33.134904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134765 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 20:42:33.134904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134779 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 20:42:33.134904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.134784 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 20:42:33.135551 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.135541 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 20:42:33.135551 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.135550 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 20:42:33.138582 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.138567 2560 server.go:1268] "Started kubelet" Jun 03 20:42:33.138667 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.138627 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 20:42:33.138727 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.138707 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 20:42:33.138778 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.138744 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 20:42:33.139421 ip-10-0-130-87 systemd[1]: Started Kubernetes Kubelet. Jun 03 20:42:33.140192 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.140179 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 20:42:33.140273 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.140190 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 20:42:33.140363 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.140340 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 20:42:33.140418 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.140366 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 20:42:33.140824 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.140810 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 03 20:42:33.145561 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.145545 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 20:42:33.145561 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.145555 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 20:42:33.145876 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.145823 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.146200 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146185 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 20:42:33.146200 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146200 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 20:42:33.146376 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146366 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 03 20:42:33.146376 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146375 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 03 20:42:33.146446 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146413 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 20:42:33.146715 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146661 2560 factory.go:55] Registering systemd factory Jun 03 20:42:33.146715 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.146679 2560 factory.go:223] Registration of the systemd container factory successfully Jun 03 20:42:33.147170 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.147063 2560 factory.go:153] Registering CRI-O factory Jun 03 20:42:33.147170 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.147076 2560 factory.go:223] Registration of the crio container factory successfully Jun 03 20:42:33.147170 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.147146 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 20:42:33.147325 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.147174 2560 factory.go:103] Registering Raw factory Jun 03 20:42:33.147325 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.147191 2560 manager.go:1196] Started watching for new ooms in manager Jun 03 20:42:33.149405 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.147867 2560 manager.go:349] Starting recovery of all containers Jun 03 20:42:33.149741 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.143388 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-87.ec2.internal.18b5aceb07880d0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-87.ec2.internal,UID:ip-10-0-130-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-87.ec2.internal,},FirstTimestamp:2026-06-03 20:42:33.13854798 +0000 UTC m=+0.347861190,LastTimestamp:2026-06-03 20:42:33.13854798 +0000 UTC m=+0.347861190,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-87.ec2.internal,}" Jun 03 20:42:33.150507 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.150485 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 20:42:33.156508 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.156483 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 20:42:33.156643 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.156576 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 20:42:33.158752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.158735 2560 manager.go:354] Recovery completed Jun 03 20:42:33.162887 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.162798 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.164515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164495 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.164559 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164528 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.164559 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164537 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.164968 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164955 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 20:42:33.164968 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164964 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.164968 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164968 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 20:42:33.165131 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.164986 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:42:33.165729 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.165713 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.165808 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.165743 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.165808 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.165757 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.166093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.166079 2560 policy_none.go:49] "None policy: Start" Jun 03 20:42:33.166145 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.166098 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 20:42:33.166145 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.166112 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 20:42:33.167001 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.166991 2560 policy_none.go:47] "Start" Jun 03 20:42:33.168765 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.168747 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rqxpq" Jun 03 20:42:33.174304 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.174230 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-87.ec2.internal.18b5aceb09144a68 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-87.ec2.internal,UID:ip-10-0-130-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-87.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-87.ec2.internal,},FirstTimestamp:2026-06-03 20:42:33.164515944 +0000 UTC m=+0.373829154,LastTimestamp:2026-06-03 20:42:33.164515944 +0000 UTC m=+0.373829154,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-87.ec2.internal,}" Jun 03 20:42:33.176723 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.176709 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rqxpq" Jun 03 20:42:33.200870 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.200855 2560 manager.go:337] "Starting Device Plugin manager" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.200898 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.200911 2560 server.go:87] "Starting device plugin registration server" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.201106 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.201120 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.201274 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.201345 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.201353 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.201877 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.201925 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.209462 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.208600 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 20:42:33.209803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.209763 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 20:42:33.209803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.209798 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 20:42:33.209862 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.209818 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 20:42:33.209862 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.209848 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 20:42:33.212042 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.212019 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:33.302231 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.302198 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.303085 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.303070 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.303152 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.303100 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.303152 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.303110 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.303152 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.303137 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.310306 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.310286 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal"] Jun 03 20:42:33.310355 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.310340 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.311012 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.310999 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.311078 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.311023 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.311078 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.311034 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.311730 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.311719 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.311771 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.311736 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-87.ec2.internal\": node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.312195 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312183 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.312300 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312285 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.312356 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312320 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.312899 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312874 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.312983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312912 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.312983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312917 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.312983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312926 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.312983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312935 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.312983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.312944 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.314010 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.313995 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.314084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.314022 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:33.314703 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.314684 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:33.314796 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.314713 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:33.314796 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.314728 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:33.331868 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.331822 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-87.ec2.internal\" not found" node="ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.335030 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.335016 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-87.ec2.internal\" not found" node="ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.336289 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.336254 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.436890 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.436860 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.447441 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.447422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9af2032c8cb4ede9403dc8ac964600b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-87.ec2.internal\" (UID: \"a9af2032c8cb4ede9403dc8ac964600b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.447518 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.447445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1ee9911b9ac1e2a3d00362c770a6ea5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal\" (UID: \"a1ee9911b9ac1e2a3d00362c770a6ea5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.447518 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.447461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ee9911b9ac1e2a3d00362c770a6ea5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal\" (UID: \"a1ee9911b9ac1e2a3d00362c770a6ea5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.537844 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.537806 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.548150 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.548129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9af2032c8cb4ede9403dc8ac964600b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-87.ec2.internal\" (UID: \"a9af2032c8cb4ede9403dc8ac964600b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.548207 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.548153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1ee9911b9ac1e2a3d00362c770a6ea5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal\" (UID: \"a1ee9911b9ac1e2a3d00362c770a6ea5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.548207 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.548169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ee9911b9ac1e2a3d00362c770a6ea5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal\" (UID: \"a1ee9911b9ac1e2a3d00362c770a6ea5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.548289 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.548208 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ee9911b9ac1e2a3d00362c770a6ea5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal\" (UID: \"a1ee9911b9ac1e2a3d00362c770a6ea5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.548289 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.548233 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9af2032c8cb4ede9403dc8ac964600b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-87.ec2.internal\" (UID: \"a9af2032c8cb4ede9403dc8ac964600b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.548289 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.548239 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1ee9911b9ac1e2a3d00362c770a6ea5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal\" (UID: \"a1ee9911b9ac1e2a3d00362c770a6ea5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.634661 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.634596 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.637949 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.637927 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.639019 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:33.639006 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:33.738886 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.738853 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.839424 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.839392 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:33.940024 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:33.939945 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:34.040511 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:34.040485 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:34.093988 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.093955 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 20:42:34.094426 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.094080 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:42:34.112841 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:34.112810 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9af2032c8cb4ede9403dc8ac964600b.slice/crio-4269529dbc159d0d4531efcd21f5dfb6d14066ab6d6cd2c27cfd77c26b1b050f WatchSource:0}: Error finding container 4269529dbc159d0d4531efcd21f5dfb6d14066ab6d6cd2c27cfd77c26b1b050f: Status 404 returned error can't find the container with id 4269529dbc159d0d4531efcd21f5dfb6d14066ab6d6cd2c27cfd77c26b1b050f Jun 03 20:42:34.113021 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:34.112997 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ee9911b9ac1e2a3d00362c770a6ea5.slice/crio-e943920e35ab5c248797471c1484709bdd75cc78900fda09fdfacccbff8d1133 WatchSource:0}: Error finding container e943920e35ab5c248797471c1484709bdd75cc78900fda09fdfacccbff8d1133: Status 404 returned error can't find the container with id e943920e35ab5c248797471c1484709bdd75cc78900fda09fdfacccbff8d1133 Jun 03 20:42:34.116946 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.116933 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:42:34.140708 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:34.140684 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:34.176798 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.176782 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:42:34.177703 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.177687 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:42:34.177775 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.177721 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:42:34.177775 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.177736 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:42:34.178865 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.178845 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 20:37:33 +0000 UTC" deadline="2027-11-17 08:04:07.408249433 +0000 UTC" Jun 03 20:42:34.178904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.178865 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12755h21m33.229386853s" Jun 03 20:42:34.213282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.213200 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" event={"ID":"a1ee9911b9ac1e2a3d00362c770a6ea5","Type":"ContainerStarted","Data":"e943920e35ab5c248797471c1484709bdd75cc78900fda09fdfacccbff8d1133"} Jun 03 20:42:34.214130 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.214107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" event={"ID":"a9af2032c8cb4ede9403dc8ac964600b","Type":"ContainerStarted","Data":"4269529dbc159d0d4531efcd21f5dfb6d14066ab6d6cd2c27cfd77c26b1b050f"} Jun 03 20:42:34.241245 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:34.241220 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-87.ec2.internal\" not found" Jun 03 20:42:34.249957 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.249936 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:34.346621 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.346601 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" Jun 03 20:42:34.358175 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.358160 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:42:34.359915 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.359903 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" Jun 03 20:42:34.372446 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.372431 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:42:34.501131 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.501062 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:34.567388 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:34.567361 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:35.130658 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.130587 2560 apiserver.go:52] "Watching apiserver" Jun 03 20:42:35.137705 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.137682 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 20:42:35.140164 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.140135 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-h4mvp","openshift-network-diagnostics/network-check-target-mvqnc","openshift-network-operator/iptables-alerter-w4bwg","openshift-ovn-kubernetes/ovnkube-node-xzb9g","kube-system/global-pull-secret-syncer-kpkdt","kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4","openshift-cluster-node-tuning-operator/tuned-btt24","openshift-dns/node-resolver-bq8cm","openshift-image-registry/node-ca-vpmsl","openshift-multus/multus-25nzd","kube-system/konnectivity-agent-fnhpl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-2lst7"] Jun 03 20:42:35.141747 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.141729 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.142830 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.142809 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.143936 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.143916 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.144549 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.144411 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.144879 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.144840 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 20:42:35.144996 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.144928 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.146022 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.145750 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.146022 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.145964 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 20:42:35.146228 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.146212 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xwm48\"" Jun 03 20:42:35.146472 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.146454 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-svfzz\"" Jun 03 20:42:35.146768 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.146746 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 20:42:35.146993 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.146976 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 20:42:35.147635 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.147246 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.147635 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.147312 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.147635 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.147400 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-68bzm\"" Jun 03 20:42:35.148037 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.148017 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.148777 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.148753 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.148897 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.148811 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 20:42:35.149363 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.149335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.150105 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.149820 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:35.150105 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.149998 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.150105 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.150076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n4sh9\"" Jun 03 20:42:35.150656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.150354 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 20:42:35.150656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.150555 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.150959 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.150942 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 20:42:35.151052 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.150962 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 20:42:35.151111 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.151071 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 20:42:35.151820 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.151804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.153098 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.153082 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.153680 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.153660 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdhc5\"" Jun 03 20:42:35.153838 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.153821 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 20:42:35.153910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.153878 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 20:42:35.154522 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.154502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.155161 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155106 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r9mrs\"" Jun 03 20:42:35.155161 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155132 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.155161 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155137 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.155374 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-conf-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.155481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-cni-netd\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovnkube-config\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.155481 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155458 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-daemon-config\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6g7q\" (UniqueName: \"kubernetes.io/projected/ac49226b-7f3f-4edf-87bd-a253b10c5af2-kube-api-access-p6g7q\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovn-node-metrics-cert\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-socket-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-hostroot\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-etc-kubernetes\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-var-lib-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-env-overrides\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovnkube-script-lib\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.155716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-sys-fs\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-kubelet\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155779 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5029da4f-e54f-403e-9de7-d206ce27da64-iptables-alerter-script\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blxqb\" (UniqueName: \"kubernetes.io/projected/5029da4f-e54f-403e-9de7-d206ce27da64-kube-api-access-blxqb\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-cni-bin\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-multus-certs\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155860 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-run-netns\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-node-log\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-cni-bin\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.155935 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-cni-multus\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-systemd-units\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.155996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-etc-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-registration-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.156197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-device-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv285\" (UniqueName: \"kubernetes.io/projected/50a42060-feae-4100-9b80-5c71630125c7-kube-api-access-cv285\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-cni-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-socket-dir-parent\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5029da4f-e54f-403e-9de7-d206ce27da64-host-slash\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156241 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-slash\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156317 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-clnl9\"" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156318 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156320 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6rxm\" (UniqueName: \"kubernetes.io/projected/59216f8c-4f19-45bf-b0a2-731a31a20a8c-kube-api-access-t6rxm\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-cnibin\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156571 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-os-release\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac49226b-7f3f-4edf-87bd-a253b10c5af2-cni-binary-copy\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156618 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-k8s-cni-cncf-io\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-kubelet\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-systemd\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-ovn\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.156910 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-log-socket\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.157674 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-system-cni-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.157674 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-netns\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.157674 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.156935 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:42:35.157674 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.157188 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.158814 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.158795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.158920 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.158879 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:35.159241 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.159212 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 20:42:35.159380 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.159233 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 20:42:35.159456 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.159398 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 20:42:35.159617 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.159600 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f2ssg\"" Jun 03 20:42:35.160452 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.160432 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.162574 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.162539 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 20:42:35.162666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.162612 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 20:42:35.162832 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.162818 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvvtj\"" Jun 03 20:42:35.179733 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.179592 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q8nwn" Jun 03 20:42:35.190422 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.190404 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q8nwn" Jun 03 20:42:35.247574 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.247550 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 20:42:35.256977 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.256959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-cni-bin\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.256989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-serviceca\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.257093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n45cl\" (UniqueName: \"kubernetes.io/projected/5e7bf515-83c9-4908-bc40-091d45e0f00a-kube-api-access-n45cl\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.257093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257025 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-tmp\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.257093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:35.257093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257065 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-cni-bin\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-etc-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257144 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-etc-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-registration-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.257242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257230 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-device-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv285\" (UniqueName: \"kubernetes.io/projected/50a42060-feae-4100-9b80-5c71630125c7-kube-api-access-cv285\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-cni-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-registration-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysctl-d\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257377 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-device-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5029da4f-e54f-403e-9de7-d206ce27da64-host-slash\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-slash\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257477 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-cni-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5029da4f-e54f-403e-9de7-d206ce27da64-host-slash\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257507 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-slash\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6rxm\" (UniqueName: \"kubernetes.io/projected/59216f8c-4f19-45bf-b0a2-731a31a20a8c-kube-api-access-t6rxm\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-cnibin\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-os-release\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-conf-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-sys\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257627 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-cnibin\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-systemd\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-ovn\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-conf-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-log-socket\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-systemd\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-run-ovn\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257687 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-os-release\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.257975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257734 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-daemon-config\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-log-socket\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6g7q\" (UniqueName: \"kubernetes.io/projected/ac49226b-7f3f-4edf-87bd-a253b10c5af2-kube-api-access-p6g7q\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysconfig\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257803 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-tuned\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257854 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-modprobe-d\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.257981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-lib-modules\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-hostroot\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258015 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-var-lib-kubelet\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-system-cni-dir\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258070 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-hostroot\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.258877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-env-overrides\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-sys-fs\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258111 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258116 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-kubelet\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a6847a3-4509-4a13-80bf-85dd8124be10-hosts-file\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258171 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5029da4f-e54f-403e-9de7-d206ce27da64-iptables-alerter-script\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-kubelet\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258149 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-sys-fs\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-cni-bin\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysctl-conf\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-host\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-cnibin\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-daemon-config\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258291 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-cni-bin\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-run-netns\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-node-log\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-run-netns\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.259593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-cni-multus\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258419 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-node-log\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-os-release\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-var-lib-cni-multus\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmb5\" (UniqueName: \"kubernetes.io/projected/68742992-94ab-4239-a62b-e79345940fb7-kube-api-access-6kmb5\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6847a3-4509-4a13-80bf-85dd8124be10-tmp-dir\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-systemd-units\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258510 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-env-overrides\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-socket-dir-parent\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258559 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-systemd-units\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258605 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-multus-socket-dir-parent\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac49226b-7f3f-4edf-87bd-a253b10c5af2-cni-binary-copy\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-k8s-cni-cncf-io\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-netns\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-k8s-cni-cncf-io\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-etc-kubernetes\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258725 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-netns\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz986\" (UniqueName: \"kubernetes.io/projected/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-kube-api-access-jz986\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258749 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-run\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258751 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-etc-kubernetes\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e202f3c2-adcf-427c-9560-95bbe6bd1883-agent-certs\") pod \"konnectivity-agent-fnhpl\" (UID: \"e202f3c2-adcf-427c-9560-95bbe6bd1883\") " pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-kubelet\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258822 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5029da4f-e54f-403e-9de7-d206ce27da64-iptables-alerter-script\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-system-cni-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-kubelet\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ba4b789-85ed-4674-9e3b-548ca3d98480-kubelet-config\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-system-cni-dir\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/0a6847a3-4509-4a13-80bf-85dd8124be10-kube-api-access-bmdvf\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-cni-netd\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.258985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovnkube-config\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-systemd\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-host-cni-netd\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.260631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259025 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n96gj\" (UniqueName: \"kubernetes.io/projected/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-kube-api-access-n96gj\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e202f3c2-adcf-427c-9560-95bbe6bd1883-konnectivity-ca\") pod \"konnectivity-agent-fnhpl\" (UID: \"e202f3c2-adcf-427c-9560-95bbe6bd1883\") " pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac49226b-7f3f-4edf-87bd-a253b10c5af2-cni-binary-copy\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ba4b789-85ed-4674-9e3b-548ca3d98480-dbus\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovn-node-metrics-cert\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259124 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-socket-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-host\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-var-lib-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovnkube-script-lib\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxqb\" (UniqueName: \"kubernetes.io/projected/5029da4f-e54f-403e-9de7-d206ce27da64-kube-api-access-blxqb\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259226 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-multus-certs\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-kubernetes\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/50a42060-feae-4100-9b80-5c71630125c7-socket-dir\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59216f8c-4f19-45bf-b0a2-731a31a20a8c-var-lib-openvswitch\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.261127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259394 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 20:42:35.261732 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259510 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovnkube-config\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.261732 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac49226b-7f3f-4edf-87bd-a253b10c5af2-host-run-multus-certs\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.261732 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.259686 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovnkube-script-lib\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.262628 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.262609 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59216f8c-4f19-45bf-b0a2-731a31a20a8c-ovn-node-metrics-cert\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.265892 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.265871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6g7q\" (UniqueName: \"kubernetes.io/projected/ac49226b-7f3f-4edf-87bd-a253b10c5af2-kube-api-access-p6g7q\") pod \"multus-25nzd\" (UID: \"ac49226b-7f3f-4edf-87bd-a253b10c5af2\") " pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.266384 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.266363 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6rxm\" (UniqueName: \"kubernetes.io/projected/59216f8c-4f19-45bf-b0a2-731a31a20a8c-kube-api-access-t6rxm\") pod \"ovnkube-node-xzb9g\" (UID: \"59216f8c-4f19-45bf-b0a2-731a31a20a8c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.266479 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.266387 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv285\" (UniqueName: \"kubernetes.io/projected/50a42060-feae-4100-9b80-5c71630125c7-kube-api-access-cv285\") pod \"aws-ebs-csi-driver-node-8lfw4\" (UID: \"50a42060-feae-4100-9b80-5c71630125c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.266833 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.266812 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blxqb\" (UniqueName: \"kubernetes.io/projected/5029da4f-e54f-403e-9de7-d206ce27da64-kube-api-access-blxqb\") pod \"iptables-alerter-w4bwg\" (UID: \"5029da4f-e54f-403e-9de7-d206ce27da64\") " pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.360055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysctl-d\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-sys\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysconfig\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-tuned\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-sys\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360186 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysconfig\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-modprobe-d\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360226 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysctl-d\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360311 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.360231 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-modprobe-d\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.360346 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:42:35.86030914 +0000 UTC m=+3.069622353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-lib-modules\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-var-lib-kubelet\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360353 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-lib-modules\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-system-cni-dir\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360447 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-var-lib-kubelet\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-system-cni-dir\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360467 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a6847a3-4509-4a13-80bf-85dd8124be10-hosts-file\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysctl-conf\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-host\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-cnibin\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a6847a3-4509-4a13-80bf-85dd8124be10-hosts-file\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-os-release\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360610 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-host\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.360666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmb5\" (UniqueName: \"kubernetes.io/projected/68742992-94ab-4239-a62b-e79345940fb7-kube-api-access-6kmb5\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-cnibin\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360648 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-os-release\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6847a3-4509-4a13-80bf-85dd8124be10-tmp-dir\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-sysctl-conf\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz986\" (UniqueName: \"kubernetes.io/projected/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-kube-api-access-jz986\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-run\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e202f3c2-adcf-427c-9560-95bbe6bd1883-agent-certs\") pod \"konnectivity-agent-fnhpl\" (UID: \"e202f3c2-adcf-427c-9560-95bbe6bd1883\") " pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ba4b789-85ed-4674-9e3b-548ca3d98480-kubelet-config\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360860 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-run\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/0a6847a3-4509-4a13-80bf-85dd8124be10-kube-api-access-bmdvf\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360897 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-systemd\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360922 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n96gj\" (UniqueName: \"kubernetes.io/projected/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-kube-api-access-n96gj\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e202f3c2-adcf-427c-9560-95bbe6bd1883-konnectivity-ca\") pod \"konnectivity-agent-fnhpl\" (UID: \"e202f3c2-adcf-427c-9560-95bbe6bd1883\") " pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360968 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ba4b789-85ed-4674-9e3b-548ca3d98480-dbus\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.361478 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360989 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6847a3-4509-4a13-80bf-85dd8124be10-tmp-dir\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361034 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-host\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.360992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-host\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-systemd\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68742992-94ab-4239-a62b-e79345940fb7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-kubernetes\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-serviceca\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45cl\" (UniqueName: \"kubernetes.io/projected/5e7bf515-83c9-4908-bc40-091d45e0f00a-kube-api-access-n45cl\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-tmp\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361355 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ba4b789-85ed-4674-9e3b-548ca3d98480-dbus\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ba4b789-85ed-4674-9e3b-548ca3d98480-kubelet-config\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.361490 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:35.362245 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.361576 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:42:35.861530058 +0000 UTC m=+3.070843260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:35.363030 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.363030 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361850 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-serviceca\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.363030 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.361913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-kubernetes\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.363030 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.362047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/68742992-94ab-4239-a62b-e79345940fb7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.363030 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.362574 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e202f3c2-adcf-427c-9560-95bbe6bd1883-konnectivity-ca\") pod \"konnectivity-agent-fnhpl\" (UID: \"e202f3c2-adcf-427c-9560-95bbe6bd1883\") " pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.363030 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.362894 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-etc-tuned\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.363421 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.363405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e202f3c2-adcf-427c-9560-95bbe6bd1883-agent-certs\") pod \"konnectivity-agent-fnhpl\" (UID: \"e202f3c2-adcf-427c-9560-95bbe6bd1883\") " pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.363954 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.363937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-tmp\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.367136 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.367116 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:35.367136 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.367139 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:35.367345 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.367153 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:35.367345 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.367231 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:35.867213778 +0000 UTC m=+3.076527005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:35.368914 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.368841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz986\" (UniqueName: \"kubernetes.io/projected/1e19f7ae-dc41-4e49-b49b-03b8717d2aba-kube-api-access-jz986\") pod \"node-ca-vpmsl\" (UID: \"1e19f7ae-dc41-4e49-b49b-03b8717d2aba\") " pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.369308 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.369286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmb5\" (UniqueName: \"kubernetes.io/projected/68742992-94ab-4239-a62b-e79345940fb7-kube-api-access-6kmb5\") pod \"multus-additional-cni-plugins-2lst7\" (UID: \"68742992-94ab-4239-a62b-e79345940fb7\") " pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.370219 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.370196 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdvf\" (UniqueName: \"kubernetes.io/projected/0a6847a3-4509-4a13-80bf-85dd8124be10-kube-api-access-bmdvf\") pod \"node-resolver-bq8cm\" (UID: \"0a6847a3-4509-4a13-80bf-85dd8124be10\") " pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.370324 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.370222 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n96gj\" (UniqueName: \"kubernetes.io/projected/f6afda31-f5ab-47fb-b5b1-c55bc748b1c4-kube-api-access-n96gj\") pod \"tuned-btt24\" (UID: \"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4\") " pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.370423 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.370407 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n45cl\" (UniqueName: \"kubernetes.io/projected/5e7bf515-83c9-4908-bc40-091d45e0f00a-kube-api-access-n45cl\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.455362 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.455291 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" Jun 03 20:42:35.462123 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.462103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-25nzd" Jun 03 20:42:35.471642 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.471617 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4bwg" Jun 03 20:42:35.477080 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.477064 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:42:35.483639 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.483619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lst7" Jun 03 20:42:35.489982 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.489967 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bq8cm" Jun 03 20:42:35.496456 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.496440 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-btt24" Jun 03 20:42:35.505892 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.505876 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vpmsl" Jun 03 20:42:35.511253 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.511236 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:35.619745 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.619717 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:42:35.865116 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.865043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:35.865116 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.865105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:35.865365 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.865219 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:35.865365 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.865225 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:35.865365 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.865289 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:42:36.86527422 +0000 UTC m=+4.074587418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:35.865365 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.865304 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:42:36.865298253 +0000 UTC m=+4.074611451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:35.895413 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.895382 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e19f7ae_dc41_4e49_b49b_03b8717d2aba.slice/crio-24358d4f2796374aaf64dc7371f6c4fbaa557c249b1d75d2b0765090f48fa71e WatchSource:0}: Error finding container 24358d4f2796374aaf64dc7371f6c4fbaa557c249b1d75d2b0765090f48fa71e: Status 404 returned error can't find the container with id 24358d4f2796374aaf64dc7371f6c4fbaa557c249b1d75d2b0765090f48fa71e Jun 03 20:42:35.896671 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.896647 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6847a3_4509_4a13_80bf_85dd8124be10.slice/crio-9182305e4dd6bcc2bbe13a5289fcbf156cf6f04a0bc265bdebead8f8e693c3e3 WatchSource:0}: Error finding container 9182305e4dd6bcc2bbe13a5289fcbf156cf6f04a0bc265bdebead8f8e693c3e3: Status 404 returned error can't find the container with id 9182305e4dd6bcc2bbe13a5289fcbf156cf6f04a0bc265bdebead8f8e693c3e3 Jun 03 20:42:35.899983 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.899944 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59216f8c_4f19_45bf_b0a2_731a31a20a8c.slice/crio-5da273f2f507f74cac9556a50d6ef1f78a60cfc32ef28386ef4828abf8983707 WatchSource:0}: Error finding container 5da273f2f507f74cac9556a50d6ef1f78a60cfc32ef28386ef4828abf8983707: Status 404 returned error can't find the container with id 5da273f2f507f74cac9556a50d6ef1f78a60cfc32ef28386ef4828abf8983707 Jun 03 20:42:35.900783 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.900719 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6afda31_f5ab_47fb_b5b1_c55bc748b1c4.slice/crio-3e2f8212d17d119ecdc611a7d19b019db547d0d4e9390909297491c856feb669 WatchSource:0}: Error finding container 3e2f8212d17d119ecdc611a7d19b019db547d0d4e9390909297491c856feb669: Status 404 returned error can't find the container with id 3e2f8212d17d119ecdc611a7d19b019db547d0d4e9390909297491c856feb669 Jun 03 20:42:35.902027 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.902001 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5029da4f_e54f_403e_9de7_d206ce27da64.slice/crio-240c19064cd2098b0526740ddd485b9656e7ab5dc9738f30150f31502df4afde WatchSource:0}: Error finding container 240c19064cd2098b0526740ddd485b9656e7ab5dc9738f30150f31502df4afde: Status 404 returned error can't find the container with id 240c19064cd2098b0526740ddd485b9656e7ab5dc9738f30150f31502df4afde Jun 03 20:42:35.903249 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.903226 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode202f3c2_adcf_427c_9560_95bbe6bd1883.slice/crio-e3dea0b79f9eb291300b6b7b9f7bb995abc069648bcc015cde56ea7536895290 WatchSource:0}: Error finding container e3dea0b79f9eb291300b6b7b9f7bb995abc069648bcc015cde56ea7536895290: Status 404 returned error can't find the container with id e3dea0b79f9eb291300b6b7b9f7bb995abc069648bcc015cde56ea7536895290 Jun 03 20:42:35.905156 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.905134 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68742992_94ab_4239_a62b_e79345940fb7.slice/crio-63e2d71d052f26e670976be7a197a94ef403aba9e53245af33046e5464e2d96e WatchSource:0}: Error finding container 63e2d71d052f26e670976be7a197a94ef403aba9e53245af33046e5464e2d96e: Status 404 returned error can't find the container with id 63e2d71d052f26e670976be7a197a94ef403aba9e53245af33046e5464e2d96e Jun 03 20:42:35.906513 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.906491 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a42060_feae_4100_9b80_5c71630125c7.slice/crio-4437ba188e84caf90d4681fddf5ba9f84299f5da6930208b128549d8f27da560 WatchSource:0}: Error finding container 4437ba188e84caf90d4681fddf5ba9f84299f5da6930208b128549d8f27da560: Status 404 returned error can't find the container with id 4437ba188e84caf90d4681fddf5ba9f84299f5da6930208b128549d8f27da560 Jun 03 20:42:35.907731 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:42:35.907421 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac49226b_7f3f_4edf_87bd_a253b10c5af2.slice/crio-b54efd6cee48883afca17b93cfafb97250e2a69ee0f9c94a20524f335c056a52 WatchSource:0}: Error finding container b54efd6cee48883afca17b93cfafb97250e2a69ee0f9c94a20524f335c056a52: Status 404 returned error can't find the container with id b54efd6cee48883afca17b93cfafb97250e2a69ee0f9c94a20524f335c056a52 Jun 03 20:42:35.965676 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:35.965519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:35.965770 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.965694 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:35.965770 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.965717 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:35.965770 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.965731 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:35.965874 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:35.965798 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:36.965776867 +0000 UTC m=+4.175090082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:36.192115 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.192010 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:37:35 +0000 UTC" deadline="2028-03-02 07:45:47.420834764 +0000 UTC" Jun 03 20:42:36.192115 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.192062 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15299h3m11.228776573s" Jun 03 20:42:36.221082 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.220836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" event={"ID":"a9af2032c8cb4ede9403dc8ac964600b","Type":"ContainerStarted","Data":"69bf2ae8bbdc21b064d6ffbbcb3e9a4f2e6d245336637728ea5b9f187b876113"} Jun 03 20:42:36.222343 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.222308 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-25nzd" event={"ID":"ac49226b-7f3f-4edf-87bd-a253b10c5af2","Type":"ContainerStarted","Data":"b54efd6cee48883afca17b93cfafb97250e2a69ee0f9c94a20524f335c056a52"} Jun 03 20:42:36.223662 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.223633 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" event={"ID":"50a42060-feae-4100-9b80-5c71630125c7","Type":"ContainerStarted","Data":"4437ba188e84caf90d4681fddf5ba9f84299f5da6930208b128549d8f27da560"} Jun 03 20:42:36.225170 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.225122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerStarted","Data":"63e2d71d052f26e670976be7a197a94ef403aba9e53245af33046e5464e2d96e"} Jun 03 20:42:36.226494 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.226471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnhpl" event={"ID":"e202f3c2-adcf-427c-9560-95bbe6bd1883","Type":"ContainerStarted","Data":"e3dea0b79f9eb291300b6b7b9f7bb995abc069648bcc015cde56ea7536895290"} Jun 03 20:42:36.227718 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.227689 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-btt24" event={"ID":"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4","Type":"ContainerStarted","Data":"3e2f8212d17d119ecdc611a7d19b019db547d0d4e9390909297491c856feb669"} Jun 03 20:42:36.229141 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.229093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4bwg" event={"ID":"5029da4f-e54f-403e-9de7-d206ce27da64","Type":"ContainerStarted","Data":"240c19064cd2098b0526740ddd485b9656e7ab5dc9738f30150f31502df4afde"} Jun 03 20:42:36.233600 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.233487 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"5da273f2f507f74cac9556a50d6ef1f78a60cfc32ef28386ef4828abf8983707"} Jun 03 20:42:36.234841 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.234788 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-87.ec2.internal" podStartSLOduration=2.23477334 podStartE2EDuration="2.23477334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:36.234696872 +0000 UTC m=+3.444010087" watchObservedRunningTime="2026-06-03 20:42:36.23477334 +0000 UTC m=+3.444086561" Jun 03 20:42:36.234959 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.234895 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bq8cm" event={"ID":"0a6847a3-4509-4a13-80bf-85dd8124be10","Type":"ContainerStarted","Data":"9182305e4dd6bcc2bbe13a5289fcbf156cf6f04a0bc265bdebead8f8e693c3e3"} Jun 03 20:42:36.236346 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.236323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vpmsl" event={"ID":"1e19f7ae-dc41-4e49-b49b-03b8717d2aba","Type":"ContainerStarted","Data":"24358d4f2796374aaf64dc7371f6c4fbaa557c249b1d75d2b0765090f48fa71e"} Jun 03 20:42:36.238403 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.238374 2560 generic.go:356] "Generic (PLEG): container finished" podID="a1ee9911b9ac1e2a3d00362c770a6ea5" containerID="175d27ece60614dad28455b8f91b4d35aad10b3ef71c454c9e21e40424b17045" exitCode=0 Jun 03 20:42:36.238496 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.238407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" event={"ID":"a1ee9911b9ac1e2a3d00362c770a6ea5","Type":"ContainerDied","Data":"175d27ece60614dad28455b8f91b4d35aad10b3ef71c454c9e21e40424b17045"} Jun 03 20:42:36.874297 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.873444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:36.874297 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.873517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:36.874297 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.873659 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:36.874297 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.873721 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:42:38.873701235 +0000 UTC m=+6.083014437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:36.874297 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.874148 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:36.874297 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.874198 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:42:38.87418312 +0000 UTC m=+6.083496321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:36.974154 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:36.974118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:36.974381 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.974360 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:36.974453 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.974391 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:36.974453 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.974412 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:36.974555 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:36.974499 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:38.974478959 +0000 UTC m=+6.183792182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:37.192771 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:37.192663 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:37:35 +0000 UTC" deadline="2027-11-22 06:10:15.664129533 +0000 UTC" Jun 03 20:42:37.192771 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:37.192726 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12873h27m38.471408873s" Jun 03 20:42:37.211706 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:37.211677 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:37.211880 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:37.211827 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:37.212296 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:37.212242 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:37.212393 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:37.212356 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:37.212447 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:37.212399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:37.212541 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:37.212495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:37.267342 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:37.267311 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" event={"ID":"a1ee9911b9ac1e2a3d00362c770a6ea5","Type":"ContainerStarted","Data":"73162cf358d9abe34c0258d28d59c02b3f85ccd2866fdc255c84092e1c5b7ef4"} Jun 03 20:42:38.892042 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:38.892006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:38.892522 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:38.892095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:38.892522 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.892200 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:38.892522 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.892218 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:38.892522 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.892288 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:42:42.892253484 +0000 UTC m=+10.101566688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:38.892522 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.892308 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:42:42.892297647 +0000 UTC m=+10.101610845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:38.992796 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:38.992711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:38.992959 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.992891 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:38.992959 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.992909 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:38.992959 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.992922 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:38.993102 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:38.992979 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:42.992962045 +0000 UTC m=+10.202275257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:39.210705 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:39.210669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:39.210878 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:39.210802 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:39.211190 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:39.211169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:39.211312 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:39.211293 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:39.211370 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:39.211341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:39.211449 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:39.211424 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:41.210594 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:41.210558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:41.210594 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:41.210558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:41.211087 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:41.210558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:41.211087 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:41.210695 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:41.211087 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:41.210811 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:41.211087 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:41.210860 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:42.927472 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:42.927438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:42.927882 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:42.927503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:42.927882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:42.927593 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:42.927882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:42.927653 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:42:50.927638247 +0000 UTC m=+18.136951448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:42.927882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:42.927593 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:42.927882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:42.927709 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:42:50.927698128 +0000 UTC m=+18.137011331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:43.029072 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:43.028856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:43.029072 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.029026 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:43.029072 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.029055 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:43.029072 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.029068 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:43.029349 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.029134 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:42:51.02911429 +0000 UTC m=+18.238427490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:43.213437 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:43.213363 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:43.213587 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:43.213450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:43.213587 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:43.213480 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:43.213587 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.213487 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:43.213587 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.213555 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:43.214690 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:43.213618 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:45.210565 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:45.210528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:45.211008 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:45.210528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:45.211008 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:45.210665 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:45.211008 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:45.210528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:45.211008 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:45.210732 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:45.211008 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:45.210878 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:47.210191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:47.210158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:47.210191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:47.210177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:47.210738 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:47.210169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:47.210738 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:47.210296 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:47.210738 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:47.210370 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:47.210738 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:47.210526 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:49.210245 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:49.210210 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:49.210699 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:49.210221 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:49.210699 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:49.210360 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:49.210699 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:49.210372 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:49.210699 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:49.210532 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:49.210699 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:49.210627 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:50.989488 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:50.989451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:50.989978 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:50.989525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:50.989978 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:50.989590 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:50.989978 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:50.989646 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:50.989978 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:50.989662 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:06.989642192 +0000 UTC m=+34.198955391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:42:50.989978 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:50.989696 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:06.989679358 +0000 UTC m=+34.198992572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:42:51.090693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:51.090651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:51.090857 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.090840 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:42:51.090904 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.090858 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:42:51.090904 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.090870 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:51.090987 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.090925 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:43:07.090906714 +0000 UTC m=+34.300219921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:42:51.210337 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:51.210301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:51.210337 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:51.210335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:51.210565 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:51.210337 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:51.210565 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.210430 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:51.210663 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.210562 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:51.210663 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:51.210635 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:53.213084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:53.213052 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:53.213547 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:53.213057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:53.213547 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:53.213162 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:53.213547 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:53.213178 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:53.213547 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:53.213281 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:53.213547 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:53.213375 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:55.210821 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.210522 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:55.211468 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.210523 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:55.211468 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:55.210898 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:55.211468 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.210523 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:55.211468 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:55.210980 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:55.211468 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:55.211042 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:55.304607 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.304575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vpmsl" event={"ID":"1e19f7ae-dc41-4e49-b49b-03b8717d2aba","Type":"ContainerStarted","Data":"11ab4a9fb1d0335510ed12b057fe89f93d11e743f11397dd4baba1f0a975ca3a"} Jun 03 20:42:55.306165 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.306124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-25nzd" event={"ID":"ac49226b-7f3f-4edf-87bd-a253b10c5af2","Type":"ContainerStarted","Data":"cf8911af5842ab8f19ff4734dcbf1169a454011c622639cc39eae7784afaee72"} Jun 03 20:42:55.307698 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.307671 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" event={"ID":"50a42060-feae-4100-9b80-5c71630125c7","Type":"ContainerStarted","Data":"adae78c9540f0db65dcdc7c590f3301a7e4bd5707aaad608f8aaf41ffc2f1eeb"} Jun 03 20:42:55.309426 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.309392 2560 generic.go:356] "Generic (PLEG): container finished" podID="68742992-94ab-4239-a62b-e79345940fb7" containerID="5cf3c5019feff4899a91cbcb890d3612b31aad9ca017245aabc9ed26e7c3d482" exitCode=0 Jun 03 20:42:55.309546 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.309485 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerDied","Data":"5cf3c5019feff4899a91cbcb890d3612b31aad9ca017245aabc9ed26e7c3d482"} Jun 03 20:42:55.311008 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.310905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnhpl" event={"ID":"e202f3c2-adcf-427c-9560-95bbe6bd1883","Type":"ContainerStarted","Data":"86123f20fddd42caeae77d4ba47fc288bfa39264ef1a3e243047f0704d100052"} Jun 03 20:42:55.312586 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.312561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-btt24" event={"ID":"f6afda31-f5ab-47fb-b5b1-c55bc748b1c4","Type":"ContainerStarted","Data":"e6e03fda1fbd7d048708909c3b9ea098dca33b16548394d2511f4fd0d0a2cd3c"} Jun 03 20:42:55.316033 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.316013 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"86232beb35db8cce5a0113946b85b797f90de02eac825a623f4ff765aaeb9320"} Jun 03 20:42:55.316146 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.316093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"cc32673b06a03483cb575d85394b17bf4ff7a751e90b99aeae1b2b64614a986c"} Jun 03 20:42:55.316200 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.316145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"58aaf67dd462f353ceaef0b121ed07edad8faf3f0383fd6878721222ca3b113b"} Jun 03 20:42:55.316200 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.316193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"c226d5316e2136ed280bc0281b809274e10bb4830814fb948ddd94ee11e24c6f"} Jun 03 20:42:55.316317 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.316236 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"7ddbbfda5566308a701c092c3d05e95432427bcb3c8566d1455f3e05aa73132d"} Jun 03 20:42:55.316317 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.316303 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"4f1cc634e2c46bfe8d470c4c0c1a1a2706cbd66785ca46af0c244c657df1674a"} Jun 03 20:42:55.317516 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.317489 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bq8cm" event={"ID":"0a6847a3-4509-4a13-80bf-85dd8124be10","Type":"ContainerStarted","Data":"fe692b71be20a97b3e4212e88f6d03e16017c4f9a2485074a572a8ab1948f31f"} Jun 03 20:42:55.321471 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.321434 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vpmsl" podStartSLOduration=3.906858989 podStartE2EDuration="22.321421522s" totalImagesPullingTime="18.414562533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:55.320892768 +0000 UTC m=+22.530205987" watchObservedRunningTime="2026-06-03 20:42:55.321421522 +0000 UTC m=+22.530734743" Jun 03 20:42:55.321705 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.321677 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-87.ec2.internal" podStartSLOduration=21.321667779 podStartE2EDuration="21.321667779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:37.282905728 +0000 UTC m=+4.492218949" watchObservedRunningTime="2026-06-03 20:42:55.321667779 +0000 UTC m=+22.530981002" Jun 03 20:42:55.338541 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.338501 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-btt24" podStartSLOduration=3.9286048730000003 podStartE2EDuration="22.338484509s" totalImagesPullingTime="18.409879636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:55.338162536 +0000 UTC m=+22.547475753" watchObservedRunningTime="2026-06-03 20:42:55.338484509 +0000 UTC m=+22.547797734" Jun 03 20:42:55.357698 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.357660 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fnhpl" podStartSLOduration=3.9496765050000002 podStartE2EDuration="22.35764411s" totalImagesPullingTime="18.407967605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:55.35698486 +0000 UTC m=+22.566298079" watchObservedRunningTime="2026-06-03 20:42:55.35764411 +0000 UTC m=+22.566957331" Jun 03 20:42:55.405646 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.405599 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-25nzd" podStartSLOduration=3.9787642439999997 podStartE2EDuration="22.405585932s" totalImagesPullingTime="18.426821688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:55.382500273 +0000 UTC m=+22.591813493" watchObservedRunningTime="2026-06-03 20:42:55.405585932 +0000 UTC m=+22.614899191" Jun 03 20:42:55.962610 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:55.962588 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 20:42:56.213064 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.212960 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T20:42:55.96260354Z","UUID":"6fee1520-2b22-408e-beba-6e718330494f","Handler":null,"Name":"","Endpoint":""} Jun 03 20:42:56.214970 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.214947 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 20:42:56.215096 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.214989 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 20:42:56.321568 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.321537 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" event={"ID":"50a42060-feae-4100-9b80-5c71630125c7","Type":"ContainerStarted","Data":"5459762b8749313060c2b10295a9da5b2ad3c9b7584c1396639613188e089d0b"} Jun 03 20:42:56.323083 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.323052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4bwg" event={"ID":"5029da4f-e54f-403e-9de7-d206ce27da64","Type":"ContainerStarted","Data":"38947c749d275400c166070a8612237a76e99f2db1934954b755252c67596dc8"} Jun 03 20:42:56.337713 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.337675 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bq8cm" podStartSLOduration=4.923781539 podStartE2EDuration="23.337661059s" totalImagesPullingTime="18.41387952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:55.419693615 +0000 UTC m=+22.629006845" watchObservedRunningTime="2026-06-03 20:42:56.337661059 +0000 UTC m=+23.546974327" Jun 03 20:42:56.338038 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:56.338011 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w4bwg" podStartSLOduration=4.901310347 podStartE2EDuration="23.338002994s" totalImagesPullingTime="18.436692647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:56.337536298 +0000 UTC m=+23.546849517" watchObservedRunningTime="2026-06-03 20:42:56.338002994 +0000 UTC m=+23.547316214" Jun 03 20:42:57.210584 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.210552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:57.210761 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.210559 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:57.210761 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.210694 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:57.210761 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:57.210665 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:57.210761 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:57.210749 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:57.210981 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:57.210852 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:57.314531 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.314496 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:57.327414 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.327374 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" event={"ID":"50a42060-feae-4100-9b80-5c71630125c7","Type":"ContainerStarted","Data":"221ee27fa6e78d861c35c72e32c290d9d39e28557d25d65ecab0732faa36a228"} Jun 03 20:42:57.331217 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.331177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"660cc91bff576cb739e75d4198336301ebaacbdabe6924fb9b248f395b65412a"} Jun 03 20:42:57.345334 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:57.345294 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lfw4" podStartSLOduration=3.739922294 podStartE2EDuration="24.345280886s" totalImagesPullingTime="20.605358592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:42:57.344696688 +0000 UTC m=+24.554009909" watchObservedRunningTime="2026-06-03 20:42:57.345280886 +0000 UTC m=+24.554594105" Jun 03 20:42:59.210664 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:59.210308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:42:59.210664 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:59.210308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:42:59.210664 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:59.210582 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:42:59.210664 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:59.210314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:42:59.210664 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:59.210642 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:42:59.211229 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:42:59.210724 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:42:59.880836 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:59.880616 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:42:59.881586 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:42:59.881285 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:43:00.341693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:00.341442 2560 generic.go:356] "Generic (PLEG): container finished" podID="68742992-94ab-4239-a62b-e79345940fb7" containerID="810b451186c185818a33626f9b902bdf679be426bbaa549fda12b40e76e8260d" exitCode=0 Jun 03 20:43:00.341693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:00.341480 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerDied","Data":"810b451186c185818a33626f9b902bdf679be426bbaa549fda12b40e76e8260d"} Jun 03 20:43:00.345693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:00.345670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" event={"ID":"59216f8c-4f19-45bf-b0a2-731a31a20a8c","Type":"ContainerStarted","Data":"b4c34381a5b4153b0d59fbfff9d34ce52d9d258272c4aca12cc53fda76a33e01"} Jun 03 20:43:00.346623 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:00.346607 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnhpl" Jun 03 20:43:00.385912 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:00.385860 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" podStartSLOduration=8.886854623 podStartE2EDuration="27.385848231s" totalImagesPullingTime="18.498993608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:00.385515267 +0000 UTC m=+27.594828478" watchObservedRunningTime="2026-06-03 20:43:00.385848231 +0000 UTC m=+27.595161451" Jun 03 20:43:01.210842 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.210811 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:01.211121 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.210852 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:01.211121 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.210854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:01.211121 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:01.210921 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:43:01.211121 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:01.211004 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:43:01.211121 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:01.211083 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:43:01.347643 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.347612 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:43:01.348112 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.348089 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:43:01.348219 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.348173 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:43:01.363436 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.363410 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:43:01.363557 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.363516 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:43:01.737229 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.737192 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvqnc"] Jun 03 20:43:01.737458 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.737324 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:01.737458 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:01.737428 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:43:01.740471 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.740444 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h4mvp"] Jun 03 20:43:01.740602 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.740547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:01.740684 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:01.740655 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:43:01.741093 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.741072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpkdt"] Jun 03 20:43:01.741183 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:01.741143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:01.741236 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:01.741223 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:43:02.351715 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:02.351683 2560 generic.go:356] "Generic (PLEG): container finished" podID="68742992-94ab-4239-a62b-e79345940fb7" containerID="8913329886dcfb78be9ee6af26c929660d895e4e26516f1ea26dbf8132e2f766" exitCode=0 Jun 03 20:43:02.352136 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:02.351765 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerDied","Data":"8913329886dcfb78be9ee6af26c929660d895e4e26516f1ea26dbf8132e2f766"} Jun 03 20:43:03.211013 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:03.210976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:03.211191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:03.211070 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:03.211191 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:03.211098 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:43:03.211191 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:03.211154 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:43:03.211191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:03.211185 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:03.211431 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:03.211249 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:43:03.355888 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:03.355855 2560 generic.go:356] "Generic (PLEG): container finished" podID="68742992-94ab-4239-a62b-e79345940fb7" containerID="1579738bdb4c04eb5ee819a3a6a153286d6869d3069032fa77189e4dcde5cfe7" exitCode=0 Jun 03 20:43:03.356226 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:03.355954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerDied","Data":"1579738bdb4c04eb5ee819a3a6a153286d6869d3069032fa77189e4dcde5cfe7"} Jun 03 20:43:05.210823 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:05.210579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:05.211303 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:05.210585 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:05.211303 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:05.210931 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:43:05.211303 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:05.210579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:05.211303 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:05.211008 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvqnc" podUID="023dc5c3-a085-48b5-8c9e-100791daef0c" Jun 03 20:43:05.211303 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:05.211130 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpkdt" podUID="7ba4b789-85ed-4674-9e3b-548ca3d98480" Jun 03 20:43:07.018308 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.018274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:07.018882 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.018342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:07.018882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.018419 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:07.018882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.018452 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:07.018882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.018486 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.018469651 +0000 UTC m=+66.227782850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:07.018882 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.018501 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret podName:7ba4b789-85ed-4674-9e3b-548ca3d98480 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.018494887 +0000 UTC m=+66.227808085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret") pod "global-pull-secret-syncer-kpkdt" (UID: "7ba4b789-85ed-4674-9e3b-548ca3d98480") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:07.062626 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.062600 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-87.ec2.internal" event="NodeReady" Jun 03 20:43:07.062771 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.062741 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 20:43:07.099986 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.099918 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66858f68bb-rlt2v"] Jun 03 20:43:07.119490 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.119444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:07.119650 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.119629 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:07.119650 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.119650 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:07.119802 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.119659 2560 projected.go:196] Error preparing data for projected volume kube-api-access-7mwxt for pod openshift-network-diagnostics/network-check-target-mvqnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:07.119802 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.119707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt podName:023dc5c3-a085-48b5-8c9e-100791daef0c nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.119690617 +0000 UTC m=+66.329003825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mwxt" (UniqueName: "kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt") pod "network-check-target-mvqnc" (UID: "023dc5c3-a085-48b5-8c9e-100791daef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:07.126838 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.126813 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-pbt2c"] Jun 03 20:43:07.126970 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.126951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.129362 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.129342 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 20:43:07.129480 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.129363 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 20:43:07.129480 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.129426 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v2mx4\"" Jun 03 20:43:07.129634 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.129613 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 20:43:07.140862 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.140842 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 20:43:07.147201 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.147183 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-pbt2c"] Jun 03 20:43:07.147309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.147215 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66858f68bb-rlt2v"] Jun 03 20:43:07.147309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.147238 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vcmwk"] Jun 03 20:43:07.147412 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.147312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.149533 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.149513 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 20:43:07.149711 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.149697 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 20:43:07.149780 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.149749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r9tvb\"" Jun 03 20:43:07.169167 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.169142 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6xpjb"] Jun 03 20:43:07.169299 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.169156 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.171634 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.171614 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 20:43:07.171736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.171667 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gs868\"" Jun 03 20:43:07.171736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.171683 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 20:43:07.189583 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.189564 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6xpjb"] Jun 03 20:43:07.189666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.189589 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vcmwk"] Jun 03 20:43:07.189715 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.189679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.192078 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.192056 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 20:43:07.192231 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.192120 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7zh4\"" Jun 03 20:43:07.192231 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.192057 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 20:43:07.192231 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.192210 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 20:43:07.210635 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.210620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:07.210635 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.210632 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:07.210972 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.210953 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:07.212989 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.212968 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:43:07.213170 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.213155 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:43:07.213238 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.213207 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:43:07.213566 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.213158 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg5sv\"" Jun 03 20:43:07.213659 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.213311 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztp69\"" Jun 03 20:43:07.213659 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.213351 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:43:07.220526 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-image-registry-private-configuration\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220617 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220617 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpxjd\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-kube-api-access-xpxjd\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220723 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f04d06a-9839-4bbd-b704-d44af730434d-ca-trust-extracted\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220768 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-registry-certificates\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220806 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-installation-pull-secrets\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220848 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-trusted-ca\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.220848 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.220842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-bound-sa-token\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.272411 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.272382 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:07.321472 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.321595 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpxjd\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-kube-api-access-xpxjd\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.321595 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321560 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73828f80-e5e7-42ff-9316-2d044649c38a-cert\") pod \"ingress-canary-6xpjb\" (UID: \"73828f80-e5e7-42ff-9316-2d044649c38a\") " pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.321672 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.321672 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/549b6c66-e747-4da5-b0ff-df490e1990e2-config-volume\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.321747 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321676 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.321747 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f04d06a-9839-4bbd-b704-d44af730434d-ca-trust-extracted\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.321747 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.321726 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:07.321747 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.321746 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:07.321896 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-registry-certificates\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.321896 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321849 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5rdd\" (UniqueName: \"kubernetes.io/projected/73828f80-e5e7-42ff-9316-2d044649c38a-kube-api-access-l5rdd\") pod \"ingress-canary-6xpjb\" (UID: \"73828f80-e5e7-42ff-9316-2d044649c38a\") " pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.321896 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.321872 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:07.821850035 +0000 UTC m=+35.031163248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:07.322084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-installation-pull-secrets\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.322084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.321975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-trusted-ca\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.322084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-bound-sa-token\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.322084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3414b686-fce4-45f7-b17d-f166e77a1421-nginx-conf\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.322084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f04d06a-9839-4bbd-b704-d44af730434d-ca-trust-extracted\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.322383 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d5sz\" (UniqueName: \"kubernetes.io/projected/549b6c66-e747-4da5-b0ff-df490e1990e2-kube-api-access-4d5sz\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.322383 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-image-registry-private-configuration\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.322383 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549b6c66-e747-4da5-b0ff-df490e1990e2-tmp-dir\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.322383 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-registry-certificates\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.322877 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.322855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-trusted-ca\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.325718 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.325701 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-installation-pull-secrets\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.325837 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.325814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-image-registry-private-configuration\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.331076 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.331051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-bound-sa-token\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.331747 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.331729 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpxjd\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-kube-api-access-xpxjd\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.355740 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.355693 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:07.422963 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.422940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3414b686-fce4-45f7-b17d-f166e77a1421-nginx-conf\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.423055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.422967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d5sz\" (UniqueName: \"kubernetes.io/projected/549b6c66-e747-4da5-b0ff-df490e1990e2-kube-api-access-4d5sz\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.423055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.422992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549b6c66-e747-4da5-b0ff-df490e1990e2-tmp-dir\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.423055 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73828f80-e5e7-42ff-9316-2d044649c38a-cert\") pod \"ingress-canary-6xpjb\" (UID: \"73828f80-e5e7-42ff-9316-2d044649c38a\") " pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.423217 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.423294 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/549b6c66-e747-4da5-b0ff-df490e1990e2-config-volume\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.423294 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.423395 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549b6c66-e747-4da5-b0ff-df490e1990e2-tmp-dir\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.423395 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5rdd\" (UniqueName: \"kubernetes.io/projected/73828f80-e5e7-42ff-9316-2d044649c38a-kube-api-access-l5rdd\") pod \"ingress-canary-6xpjb\" (UID: \"73828f80-e5e7-42ff-9316-2d044649c38a\") " pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.423395 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.423386 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:07.423531 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.423411 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:07.423531 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.423459 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:07.923439439 +0000 UTC m=+35.132752642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:07.423531 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.423478 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:07.923468214 +0000 UTC m=+35.132781413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:07.423745 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.423726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3414b686-fce4-45f7-b17d-f166e77a1421-nginx-conf\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.425247 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.425230 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73828f80-e5e7-42ff-9316-2d044649c38a-cert\") pod \"ingress-canary-6xpjb\" (UID: \"73828f80-e5e7-42ff-9316-2d044649c38a\") " pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.429499 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.429478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/549b6c66-e747-4da5-b0ff-df490e1990e2-config-volume\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.431134 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.431068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d5sz\" (UniqueName: \"kubernetes.io/projected/549b6c66-e747-4da5-b0ff-df490e1990e2-kube-api-access-4d5sz\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.431207 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.431138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5rdd\" (UniqueName: \"kubernetes.io/projected/73828f80-e5e7-42ff-9316-2d044649c38a-kube-api-access-l5rdd\") pod \"ingress-canary-6xpjb\" (UID: \"73828f80-e5e7-42ff-9316-2d044649c38a\") " pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.498389 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.498373 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6xpjb" Jun 03 20:43:07.644291 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.643962 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6xpjb"] Jun 03 20:43:07.647936 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:43:07.647905 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73828f80_e5e7_42ff_9316_2d044649c38a.slice/crio-fe5f310ec40c234c7e3d649fe2582c0476ce44d3fb5fdff65e8a521ac1cbfffc WatchSource:0}: Error finding container fe5f310ec40c234c7e3d649fe2582c0476ce44d3fb5fdff65e8a521ac1cbfffc: Status 404 returned error can't find the container with id fe5f310ec40c234c7e3d649fe2582c0476ce44d3fb5fdff65e8a521ac1cbfffc Jun 03 20:43:07.827281 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.827237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:07.827430 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.827387 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:07.827430 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.827406 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:07.827539 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.827474 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:08.82745377 +0000 UTC m=+36.036766988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:07.928482 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.928453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:07.928613 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:07.928488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:07.928613 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.928591 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:07.928723 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.928648 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:08.928634838 +0000 UTC m=+36.137948037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:07.928723 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.928649 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:07.928723 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:07.928697 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:08.928681738 +0000 UTC m=+36.137994935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:08.372985 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:08.372911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6xpjb" event={"ID":"73828f80-e5e7-42ff-9316-2d044649c38a","Type":"ContainerStarted","Data":"fe5f310ec40c234c7e3d649fe2582c0476ce44d3fb5fdff65e8a521ac1cbfffc"} Jun 03 20:43:08.375945 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:08.375917 2560 generic.go:356] "Generic (PLEG): container finished" podID="68742992-94ab-4239-a62b-e79345940fb7" containerID="916591b074fd84313a057d52d29feba67b9cd8e3fa46058e92e3e3a7b29086df" exitCode=0 Jun 03 20:43:08.376096 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:08.375975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerDied","Data":"916591b074fd84313a057d52d29feba67b9cd8e3fa46058e92e3e3a7b29086df"} Jun 03 20:43:08.836553 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:08.836514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:08.836710 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.836658 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:08.836710 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.836676 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:08.836792 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.836734 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:10.836712126 +0000 UTC m=+38.046025324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:08.937449 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:08.937417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:08.937449 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:08.937450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:08.937632 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.937550 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:08.937632 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.937552 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:08.937632 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.937601 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:10.937586837 +0000 UTC m=+38.146900035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:08.937632 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:08.937614 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:10.937607944 +0000 UTC m=+38.146921142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:09.381609 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:09.381574 2560 generic.go:356] "Generic (PLEG): container finished" podID="68742992-94ab-4239-a62b-e79345940fb7" containerID="665d21ef91b358f8e15d28c243d94f2c0ad6a0ddaba570fdd542295cb5a5ea9f" exitCode=0 Jun 03 20:43:09.382092 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:09.381643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerDied","Data":"665d21ef91b358f8e15d28c243d94f2c0ad6a0ddaba570fdd542295cb5a5ea9f"} Jun 03 20:43:09.512495 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:09.512448 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:10.391438 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.391124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lst7" event={"ID":"68742992-94ab-4239-a62b-e79345940fb7","Type":"ContainerStarted","Data":"589e502603d3b93b63ad33fce85bccdadf2fa8562662799f7a284fe59a4fae6e"} Jun 03 20:43:10.392499 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.392480 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6xpjb" event={"ID":"73828f80-e5e7-42ff-9316-2d044649c38a","Type":"ContainerStarted","Data":"9d7e1896fe0aeb7bcd7f6136d687d7715bf0a84837925a02033be10ad2f16c2b"} Jun 03 20:43:10.414512 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.414472 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2lst7" podStartSLOduration=8.686275955 podStartE2EDuration="37.414457645s" totalImagesPullingTime="28.72818169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:10.414031815 +0000 UTC m=+37.623345035" watchObservedRunningTime="2026-06-03 20:43:10.414457645 +0000 UTC m=+37.623770864" Jun 03 20:43:10.429140 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.429103 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6xpjb" podStartSLOduration=1.106862781 podStartE2EDuration="3.429090189s" totalImagesPullingTime="2.322227408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:10.428688535 +0000 UTC m=+37.638001818" watchObservedRunningTime="2026-06-03 20:43:10.429090189 +0000 UTC m=+37.638403446" Jun 03 20:43:10.543141 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.543112 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:10.644029 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.643933 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:10.852334 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.852303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:10.852510 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.852487 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:10.852559 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.852517 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:10.852596 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.852586 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:14.852566193 +0000 UTC m=+42.061879409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:10.952752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.952715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:10.952752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:10.952749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:10.952930 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.952855 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:10.952930 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.952865 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:10.952930 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.952917 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:14.952903181 +0000 UTC m=+42.162216379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:10.952930 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:10.952931 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:14.952925165 +0000 UTC m=+42.162238363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:11.144774 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:11.144730 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:11.204084 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:11.204002 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:12.318861 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:12.318832 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:12.380790 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:12.380744 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:14.497318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:14.497284 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:14.595185 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:14.595157 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:14.880865 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:14.880790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:14.880993 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.880901 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:14.880993 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.880914 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:14.880993 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.880962 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:22.880948867 +0000 UTC m=+50.090262064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:14.981588 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:14.981560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:14.981588 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:14.981591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:14.981764 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.981684 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:14.981764 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.981701 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:14.981764 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.981730 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:22.981717915 +0000 UTC m=+50.191031114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:14.981764 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:14.981756 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:22.981742993 +0000 UTC m=+50.191056191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:15.381527 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:15.381492 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:15.443456 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:15.443424 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:22.936400 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:22.936368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:22.936805 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:22.936487 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:22.936805 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:22.936501 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:22.936805 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:22.936557 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:43:38.936540053 +0000 UTC m=+66.145853251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:23.037201 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:23.037161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:23.037201 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:23.037198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:23.037401 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:23.037314 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:23.037401 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:23.037317 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:23.037401 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:23.037370 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.037356701 +0000 UTC m=+66.246669899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:23.037401 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:23.037384 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.037377941 +0000 UTC m=+66.246691138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:33.366107 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:33.366083 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xzb9g" Jun 03 20:43:38.947860 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:38.947829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:43:38.948323 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:38.947977 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:38.948323 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:38.947997 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:43:38.948323 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:38.948055 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:44:10.948039472 +0000 UTC m=+98.157352673 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:43:39.048742 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.048712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:43:39.048899 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.048767 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:39.048899 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.048786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:43:39.048899 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.048803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:43:39.048899 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:39.048898 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:39.049094 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:39.048914 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:43:39.049094 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:39.048974 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:11.048955967 +0000 UTC m=+98.258269192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:43:39.049094 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:39.048992 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:11.048983309 +0000 UTC m=+98.258296507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:43:39.051585 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.051567 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:43:39.051637 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.051585 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:43:39.059951 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:39.059932 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:43:39.060057 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:43:39.060003 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:44:43.05998475 +0000 UTC m=+130.269297959 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : secret "metrics-daemon-secret" not found Jun 03 20:43:39.063611 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.063583 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ba4b789-85ed-4674-9e3b-548ca3d98480-original-pull-secret\") pod \"global-pull-secret-syncer-kpkdt\" (UID: \"7ba4b789-85ed-4674-9e3b-548ca3d98480\") " pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:39.149825 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.149797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:39.152506 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.152490 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:43:39.163408 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.163386 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:43:39.173563 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.173537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwxt\" (UniqueName: \"kubernetes.io/projected/023dc5c3-a085-48b5-8c9e-100791daef0c-kube-api-access-7mwxt\") pod \"network-check-target-mvqnc\" (UID: \"023dc5c3-a085-48b5-8c9e-100791daef0c\") " pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:39.323384 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.323316 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztp69\"" Jun 03 20:43:39.328149 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.328135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpkdt" Jun 03 20:43:39.331656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.331641 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:39.455461 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.455422 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpkdt"] Jun 03 20:43:39.458571 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:43:39.458544 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba4b789_85ed_4674_9e3b_548ca3d98480.slice/crio-2187004f4071c11e060ef6e8268b22bf0a47bb92ff859190053ffbf420d7b05b WatchSource:0}: Error finding container 2187004f4071c11e060ef6e8268b22bf0a47bb92ff859190053ffbf420d7b05b: Status 404 returned error can't find the container with id 2187004f4071c11e060ef6e8268b22bf0a47bb92ff859190053ffbf420d7b05b Jun 03 20:43:39.469716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:39.469695 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvqnc"] Jun 03 20:43:39.472104 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:43:39.472082 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023dc5c3_a085_48b5_8c9e_100791daef0c.slice/crio-4f3cc07e279e225dc0009b3e66bba627d86f8b3f229d8100a4ab1afd54d4215d WatchSource:0}: Error finding container 4f3cc07e279e225dc0009b3e66bba627d86f8b3f229d8100a4ab1afd54d4215d: Status 404 returned error can't find the container with id 4f3cc07e279e225dc0009b3e66bba627d86f8b3f229d8100a4ab1afd54d4215d Jun 03 20:43:40.462526 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:40.462481 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvqnc" event={"ID":"023dc5c3-a085-48b5-8c9e-100791daef0c","Type":"ContainerStarted","Data":"4f3cc07e279e225dc0009b3e66bba627d86f8b3f229d8100a4ab1afd54d4215d"} Jun 03 20:43:40.465389 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:40.465357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpkdt" event={"ID":"7ba4b789-85ed-4674-9e3b-548ca3d98480","Type":"ContainerStarted","Data":"2187004f4071c11e060ef6e8268b22bf0a47bb92ff859190053ffbf420d7b05b"} Jun 03 20:43:44.477328 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:44.477288 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvqnc" event={"ID":"023dc5c3-a085-48b5-8c9e-100791daef0c","Type":"ContainerStarted","Data":"cc406588186d13fc1bc725470fd06993f79014b6fe20b0999fdc5098f85dc4b0"} Jun 03 20:43:44.477836 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:44.477392 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:43:44.478761 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:44.478742 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpkdt" event={"ID":"7ba4b789-85ed-4674-9e3b-548ca3d98480","Type":"ContainerStarted","Data":"19760288bf559f47f03a48f3c6b1249bc11e24b254c5355e3c0a45a2823190f6"} Jun 03 20:43:44.491804 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:44.491767 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mvqnc" podStartSLOduration=67.0093862 podStartE2EDuration="1m11.491756698s" totalImagesPullingTime="4.482370498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:44.490896605 +0000 UTC m=+71.700209825" watchObservedRunningTime="2026-06-03 20:43:44.491756698 +0000 UTC m=+71.701069895" Jun 03 20:43:44.504251 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:43:44.504212 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kpkdt" podStartSLOduration=67.001607889 podStartE2EDuration="1m11.504200432s" totalImagesPullingTime="4.502592543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:44.503655606 +0000 UTC m=+71.712968828" watchObservedRunningTime="2026-06-03 20:43:44.504200432 +0000 UTC m=+71.713513651" Jun 03 20:44:10.989279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:44:10.989155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:44:10.989653 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:10.989335 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:44:10.989653 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:10.989354 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:44:10.989653 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:10.989408 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:45:14.989390573 +0000 UTC m=+162.198703772 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:44:11.089453 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:44:11.089419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:44:11.089618 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:44:11.089459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:44:11.089618 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:11.089566 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:44:11.089618 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:11.089610 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:11.089755 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:11.089630 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:15.089611166 +0000 UTC m=+162.298924364 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:44:11.089755 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:11.089669 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:15.089652112 +0000 UTC m=+162.298965316 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:44:15.482862 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:44:15.482820 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mvqnc" Jun 03 20:44:43.106891 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:44:43.106853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:44:43.107445 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:43.106972 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:44:43.107445 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:44:43.107053 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:46:45.107032804 +0000 UTC m=+252.316346007 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : secret "metrics-daemon-secret" not found Jun 03 20:45:10.142670 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:10.142631 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" Jun 03 20:45:10.170211 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:10.170190 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" podUID="3414b686-fce4-45f7-b17d-f166e77a1421" Jun 03 20:45:10.178452 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:10.178434 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vcmwk" podUID="549b6c66-e747-4da5-b0ff-df490e1990e2" Jun 03 20:45:10.233287 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:10.233240 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:45:10.675012 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:10.674989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:45:10.675153 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:10.674989 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcmwk" Jun 03 20:45:15.033727 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:15.033690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:45:15.034125 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.033841 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:45:15.034125 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.033860 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66858f68bb-rlt2v: secret "image-registry-tls" not found Jun 03 20:45:15.034125 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.033922 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls podName:7f04d06a-9839-4bbd-b704-d44af730434d nodeName:}" failed. No retries permitted until 2026-06-03 20:47:17.033906564 +0000 UTC m=+284.243219762 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls") pod "image-registry-66858f68bb-rlt2v" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d") : secret "image-registry-tls" not found Jun 03 20:45:15.134519 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:15.134487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:45:15.134519 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:15.134521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:45:15.134666 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.134611 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:45:15.134666 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.134624 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:45:15.134725 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.134669 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls podName:549b6c66-e747-4da5-b0ff-df490e1990e2 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:17.134655842 +0000 UTC m=+284.343969041 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls") pod "dns-default-vcmwk" (UID: "549b6c66-e747-4da5-b0ff-df490e1990e2") : secret "dns-default-metrics-tls" not found Jun 03 20:45:15.134725 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:45:15.134681 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert podName:3414b686-fce4-45f7-b17d-f166e77a1421 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:17.134675253 +0000 UTC m=+284.343988452 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-pbt2c" (UID: "3414b686-fce4-45f7-b17d-f166e77a1421") : secret "networking-console-plugin-cert" not found Jun 03 20:45:25.211126 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:25.211027 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:45:25.211590 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:45:25.211238 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:46:40.606203 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.606165 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-sjfdn"] Jun 03 20:46:40.609186 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.609165 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.611688 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.611649 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 20:46:40.611688 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.611678 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:40.612082 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.612066 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 20:46:40.612666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.612644 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8"] Jun 03 20:46:40.613555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.613531 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:40.613719 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.613694 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xklkv\"" Jun 03 20:46:40.615524 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.615506 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2"] Jun 03 20:46:40.615674 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.615630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:40.617509 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.617489 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 20:46:40.618298 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.618281 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-dtmqt"] Jun 03 20:46:40.618423 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.618405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.618494 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.618467 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:40.618557 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.618505 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 20:46:40.618646 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.618414 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:40.620816 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.620798 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wnfgh\"" Jun 03 20:46:40.621105 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.621090 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-sjfdn"] Jun 03 20:46:40.621191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.621146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 20:46:40.621191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.621159 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.621325 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.621227 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 20:46:40.621325 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.621254 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rrwlg\"" Jun 03 20:46:40.621733 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.621718 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:40.622750 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.622729 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:40.623148 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623125 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6815212-41bf-49f5-9e90-d676cfc64884-trusted-ca-bundle\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.623233 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6dmv\" (UniqueName: \"kubernetes.io/projected/b6815212-41bf-49f5-9e90-d676cfc64884-kube-api-access-f6dmv\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.623233 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bfdc206-b0eb-40d8-a755-5d30a15ae819-trusted-ca\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.623233 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6815212-41bf-49f5-9e90-d676cfc64884-service-ca-bundle\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.623387 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfdc206-b0eb-40d8-a755-5d30a15ae819-serving-cert\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.623387 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:40.623387 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7c359a9-87d0-45bc-a248-c71737339828-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.623387 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nmnw\" (UniqueName: \"kubernetes.io/projected/c7c359a9-87d0-45bc-a248-c71737339828-kube-api-access-4nmnw\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.623552 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7c359a9-87d0-45bc-a248-c71737339828-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.623552 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgp7v\" (UniqueName: \"kubernetes.io/projected/9bfdc206-b0eb-40d8-a755-5d30a15ae819-kube-api-access-dgp7v\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.623552 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6815212-41bf-49f5-9e90-d676cfc64884-snapshots\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.623660 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctkl4\" (UniqueName: \"kubernetes.io/projected/b2552856-9965-4440-8ce3-a3b9a7a58eb9-kube-api-access-ctkl4\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:40.623660 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6815212-41bf-49f5-9e90-d676cfc64884-tmp\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.623723 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bfdc206-b0eb-40d8-a755-5d30a15ae819-config\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.623723 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6815212-41bf-49f5-9e90-d676cfc64884-serving-cert\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.623887 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623869 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 20:46:40.624285 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623916 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 20:46:40.624369 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.623994 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 20:46:40.624426 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.624078 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6wtcw\"" Jun 03 20:46:40.624486 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.624429 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 20:46:40.629196 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.629172 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 20:46:40.629467 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.629444 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8"] Jun 03 20:46:40.633502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.633480 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2"] Jun 03 20:46:40.634316 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.634294 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-dtmqt"] Jun 03 20:46:40.711850 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.711813 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx"] Jun 03 20:46:40.715004 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.714989 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229"] Jun 03 20:46:40.715127 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.715108 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.717523 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.717503 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.721900 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.721803 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:40.722194 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.722175 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 20:46:40.722660 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.722641 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:40.724866 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.724843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bfdc206-b0eb-40d8-a755-5d30a15ae819-config\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.725034 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6815212-41bf-49f5-9e90-d676cfc64884-serving-cert\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.725164 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6815212-41bf-49f5-9e90-d676cfc64884-trusted-ca-bundle\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.725308 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6dmv\" (UniqueName: \"kubernetes.io/projected/b6815212-41bf-49f5-9e90-d676cfc64884-kube-api-access-f6dmv\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.725476 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bfdc206-b0eb-40d8-a755-5d30a15ae819-trusted-ca\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.725586 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6815212-41bf-49f5-9e90-d676cfc64884-service-ca-bundle\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.725695 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bfdc206-b0eb-40d8-a755-5d30a15ae819-config\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.725764 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfdc206-b0eb-40d8-a755-5d30a15ae819-serving-cert\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.725821 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk9nf\" (UniqueName: \"kubernetes.io/projected/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-kube-api-access-rk9nf\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.725821 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:40.725919 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725863 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7c359a9-87d0-45bc-a248-c71737339828-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.725972 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nmnw\" (UniqueName: \"kubernetes.io/projected/c7c359a9-87d0-45bc-a248-c71737339828-kube-api-access-4nmnw\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.726026 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:40.725985 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:40.726026 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.725992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/79d91fb2-d56d-4245-aefc-5877f67425ae-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.726126 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.726126 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:40.726057 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls podName:b2552856-9965-4440-8ce3-a3b9a7a58eb9 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:41.226037624 +0000 UTC m=+248.435350823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-75ck8" (UID: "b2552856-9965-4440-8ce3-a3b9a7a58eb9") : secret "samples-operator-tls" not found Jun 03 20:46:40.726355 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7c359a9-87d0-45bc-a248-c71737339828-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.726501 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgp7v\" (UniqueName: \"kubernetes.io/projected/9bfdc206-b0eb-40d8-a755-5d30a15ae819-kube-api-access-dgp7v\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.726501 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvdm\" (UniqueName: \"kubernetes.io/projected/79d91fb2-d56d-4245-aefc-5877f67425ae-kube-api-access-ztvdm\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.726501 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-serving-cert\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.726643 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6815212-41bf-49f5-9e90-d676cfc64884-snapshots\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.726643 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-config\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.726643 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctkl4\" (UniqueName: \"kubernetes.io/projected/b2552856-9965-4440-8ce3-a3b9a7a58eb9-kube-api-access-ctkl4\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:40.726643 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.726611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6815212-41bf-49f5-9e90-d676cfc64884-tmp\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.727110 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.727089 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7c359a9-87d0-45bc-a248-c71737339828-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.727317 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.727295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6815212-41bf-49f5-9e90-d676cfc64884-tmp\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.727813 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.727788 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6815212-41bf-49f5-9e90-d676cfc64884-snapshots\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.728088 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.728066 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6815212-41bf-49f5-9e90-d676cfc64884-service-ca-bundle\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.728838 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.728813 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7c359a9-87d0-45bc-a248-c71737339828-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.730414 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.730392 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7csnm\"" Jun 03 20:46:40.730818 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.730558 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6815212-41bf-49f5-9e90-d676cfc64884-serving-cert\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.730818 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.730629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bfdc206-b0eb-40d8-a755-5d30a15ae819-serving-cert\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.731300 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.731032 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 20:46:40.731300 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.731040 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 20:46:40.731300 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.731083 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 20:46:40.731847 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.731817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bfdc206-b0eb-40d8-a755-5d30a15ae819-trusted-ca\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.731977 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.731956 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6815212-41bf-49f5-9e90-d676cfc64884-trusted-ca-bundle\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.738157 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.738143 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 20:46:40.738236 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.738156 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 20:46:40.738383 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.738297 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v5k8h\"" Jun 03 20:46:40.753975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.753952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctkl4\" (UniqueName: \"kubernetes.io/projected/b2552856-9965-4440-8ce3-a3b9a7a58eb9-kube-api-access-ctkl4\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:40.764782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.764763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nmnw\" (UniqueName: \"kubernetes.io/projected/c7c359a9-87d0-45bc-a248-c71737339828-kube-api-access-4nmnw\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2\" (UID: \"c7c359a9-87d0-45bc-a248-c71737339828\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.766619 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.766596 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx"] Jun 03 20:46:40.767973 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.767949 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6dmv\" (UniqueName: \"kubernetes.io/projected/b6815212-41bf-49f5-9e90-d676cfc64884-kube-api-access-f6dmv\") pod \"insights-operator-69684796bc-dtmqt\" (UID: \"b6815212-41bf-49f5-9e90-d676cfc64884\") " pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:40.769163 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.769125 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgp7v\" (UniqueName: \"kubernetes.io/projected/9bfdc206-b0eb-40d8-a755-5d30a15ae819-kube-api-access-dgp7v\") pod \"console-operator-85bd8fd97d-sjfdn\" (UID: \"9bfdc206-b0eb-40d8-a755-5d30a15ae819\") " pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.795719 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.795682 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229"] Jun 03 20:46:40.827890 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.827859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-config\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.828026 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.827924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9nf\" (UniqueName: \"kubernetes.io/projected/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-kube-api-access-rk9nf\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.828026 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.827962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/79d91fb2-d56d-4245-aefc-5877f67425ae-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.828026 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.827983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.828026 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.828022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvdm\" (UniqueName: \"kubernetes.io/projected/79d91fb2-d56d-4245-aefc-5877f67425ae-kube-api-access-ztvdm\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.828222 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.828047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-serving-cert\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.828222 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:40.828123 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:40.828222 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:40.828197 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls podName:79d91fb2-d56d-4245-aefc-5877f67425ae nodeName:}" failed. No retries permitted until 2026-06-03 20:46:41.328181225 +0000 UTC m=+248.537494439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-bjjbx" (UID: "79d91fb2-d56d-4245-aefc-5877f67425ae") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:40.828486 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.828458 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-config\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.828736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.828718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/79d91fb2-d56d-4245-aefc-5877f67425ae-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.830159 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.830141 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-serving-cert\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.837757 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.837736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9nf\" (UniqueName: \"kubernetes.io/projected/162a2cd3-0796-4f76-b828-ac5aa4edb9e9-kube-api-access-rk9nf\") pod \"service-ca-operator-5bc4cf794b-dn229\" (UID: \"162a2cd3-0796-4f76-b828-ac5aa4edb9e9\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:40.837842 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.837809 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvdm\" (UniqueName: \"kubernetes.io/projected/79d91fb2-d56d-4245-aefc-5877f67425ae-kube-api-access-ztvdm\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:40.919348 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.919248 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:40.936119 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.936098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" Jun 03 20:46:40.941921 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:40.941891 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-dtmqt" Jun 03 20:46:41.040499 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.040474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" Jun 03 20:46:41.059415 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.059284 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-sjfdn"] Jun 03 20:46:41.060705 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:46:41.060678 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfdc206_b0eb_40d8_a755_5d30a15ae819.slice/crio-f02782054c9aad84fc94e46fdff749877020f40503f478ac07e21d83d6a78475 WatchSource:0}: Error finding container f02782054c9aad84fc94e46fdff749877020f40503f478ac07e21d83d6a78475: Status 404 returned error can't find the container with id f02782054c9aad84fc94e46fdff749877020f40503f478ac07e21d83d6a78475 Jun 03 20:46:41.161074 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.161041 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229"] Jun 03 20:46:41.164782 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:46:41.164758 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162a2cd3_0796_4f76_b828_ac5aa4edb9e9.slice/crio-b3cb0cc1242115cb0d5ab4eda579efecfd5b10e12d5cde059d9e3ceb143c607f WatchSource:0}: Error finding container b3cb0cc1242115cb0d5ab4eda579efecfd5b10e12d5cde059d9e3ceb143c607f: Status 404 returned error can't find the container with id b3cb0cc1242115cb0d5ab4eda579efecfd5b10e12d5cde059d9e3ceb143c607f Jun 03 20:46:41.231453 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.231428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:41.231577 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:41.231561 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:41.231629 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:41.231615 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls podName:b2552856-9965-4440-8ce3-a3b9a7a58eb9 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:42.231600522 +0000 UTC m=+249.440913724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-75ck8" (UID: "b2552856-9965-4440-8ce3-a3b9a7a58eb9") : secret "samples-operator-tls" not found Jun 03 20:46:41.282672 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.282648 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2"] Jun 03 20:46:41.284786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.284741 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-dtmqt"] Jun 03 20:46:41.285985 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:46:41.285954 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c359a9_87d0_45bc_a248_c71737339828.slice/crio-e4dc4e400a9e93043dd997c6c89d22ed530a58106c4fddabaaa7343a7cb9c7c6 WatchSource:0}: Error finding container e4dc4e400a9e93043dd997c6c89d22ed530a58106c4fddabaaa7343a7cb9c7c6: Status 404 returned error can't find the container with id e4dc4e400a9e93043dd997c6c89d22ed530a58106c4fddabaaa7343a7cb9c7c6 Jun 03 20:46:41.289296 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:46:41.287628 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6815212_41bf_49f5_9e90_d676cfc64884.slice/crio-282ea448a44f22c6edb27b2d569679ad41d5d6898833ed496a1dccb728e4d443 WatchSource:0}: Error finding container 282ea448a44f22c6edb27b2d569679ad41d5d6898833ed496a1dccb728e4d443: Status 404 returned error can't find the container with id 282ea448a44f22c6edb27b2d569679ad41d5d6898833ed496a1dccb728e4d443 Jun 03 20:46:41.332668 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.332646 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:41.332800 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:41.332783 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:41.332846 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:41.332837 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls podName:79d91fb2-d56d-4245-aefc-5877f67425ae nodeName:}" failed. No retries permitted until 2026-06-03 20:46:42.332824111 +0000 UTC m=+249.542137309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-bjjbx" (UID: "79d91fb2-d56d-4245-aefc-5877f67425ae") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:41.890937 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.890896 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" event={"ID":"c7c359a9-87d0-45bc-a248-c71737339828","Type":"ContainerStarted","Data":"e4dc4e400a9e93043dd997c6c89d22ed530a58106c4fddabaaa7343a7cb9c7c6"} Jun 03 20:46:41.892638 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.892606 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" event={"ID":"162a2cd3-0796-4f76-b828-ac5aa4edb9e9","Type":"ContainerStarted","Data":"b3cb0cc1242115cb0d5ab4eda579efecfd5b10e12d5cde059d9e3ceb143c607f"} Jun 03 20:46:41.894758 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.894720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-dtmqt" event={"ID":"b6815212-41bf-49f5-9e90-d676cfc64884","Type":"ContainerStarted","Data":"282ea448a44f22c6edb27b2d569679ad41d5d6898833ed496a1dccb728e4d443"} Jun 03 20:46:41.896285 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:41.896240 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" event={"ID":"9bfdc206-b0eb-40d8-a755-5d30a15ae819","Type":"ContainerStarted","Data":"f02782054c9aad84fc94e46fdff749877020f40503f478ac07e21d83d6a78475"} Jun 03 20:46:42.241782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:42.241740 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:42.242669 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:42.242204 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:42.242669 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:42.242290 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls podName:b2552856-9965-4440-8ce3-a3b9a7a58eb9 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:44.242253355 +0000 UTC m=+251.451566559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-75ck8" (UID: "b2552856-9965-4440-8ce3-a3b9a7a58eb9") : secret "samples-operator-tls" not found Jun 03 20:46:42.342761 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:42.342722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:42.342933 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:42.342889 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:42.343001 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:42.342967 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls podName:79d91fb2-d56d-4245-aefc-5877f67425ae nodeName:}" failed. No retries permitted until 2026-06-03 20:46:44.342947583 +0000 UTC m=+251.552260793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-bjjbx" (UID: "79d91fb2-d56d-4245-aefc-5877f67425ae") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:44.258526 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.258487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:44.258964 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:44.258613 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:44.258964 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:44.258670 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls podName:b2552856-9965-4440-8ce3-a3b9a7a58eb9 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.258655242 +0000 UTC m=+255.467968441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-75ck8" (UID: "b2552856-9965-4440-8ce3-a3b9a7a58eb9") : secret "samples-operator-tls" not found Jun 03 20:46:44.359133 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.359089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:44.359333 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:44.359254 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:44.359412 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:44.359355 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls podName:79d91fb2-d56d-4245-aefc-5877f67425ae nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.359334535 +0000 UTC m=+255.568647739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-bjjbx" (UID: "79d91fb2-d56d-4245-aefc-5877f67425ae") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:44.906606 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.906509 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" event={"ID":"162a2cd3-0796-4f76-b828-ac5aa4edb9e9","Type":"ContainerStarted","Data":"943dab9381d879f61e3805b2a9f91f51d37cb3ed8b54214f4f03f2b729dc5d08"} Jun 03 20:46:44.908064 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.908036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-dtmqt" event={"ID":"b6815212-41bf-49f5-9e90-d676cfc64884","Type":"ContainerStarted","Data":"d5158660bd64c2f6e0514120cc217a2e48ff3a71229f505e82d6066c10652a06"} Jun 03 20:46:44.909699 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.909668 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/0.log" Jun 03 20:46:44.909830 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.909711 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" containerID="c4a8d0e8333d1a2e68866948364879da9d127afb117f953189fd7e92bdbbd13a" exitCode=255 Jun 03 20:46:44.909830 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.909822 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" event={"ID":"9bfdc206-b0eb-40d8-a755-5d30a15ae819","Type":"ContainerDied","Data":"c4a8d0e8333d1a2e68866948364879da9d127afb117f953189fd7e92bdbbd13a"} Jun 03 20:46:44.910147 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.909971 2560 scope.go:117] "RemoveContainer" containerID="c4a8d0e8333d1a2e68866948364879da9d127afb117f953189fd7e92bdbbd13a" Jun 03 20:46:44.912446 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.912411 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" event={"ID":"c7c359a9-87d0-45bc-a248-c71737339828","Type":"ContainerStarted","Data":"b3e14b1c83c6ffdb24f9c2c7537a858c2c625df5abd516fa30feb994eb430796"} Jun 03 20:46:44.923763 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.921445 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" podStartSLOduration=1.640836363 podStartE2EDuration="4.921428347s" totalImagesPullingTime="3.280591984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:44.921011273 +0000 UTC m=+252.130324494" watchObservedRunningTime="2026-06-03 20:46:44.921428347 +0000 UTC m=+252.130741559" Jun 03 20:46:44.974120 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.974052 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" podStartSLOduration=1.821352127 podStartE2EDuration="4.974032493s" totalImagesPullingTime="3.152680366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:44.953952656 +0000 UTC m=+252.163265876" watchObservedRunningTime="2026-06-03 20:46:44.974032493 +0000 UTC m=+252.183345713" Jun 03 20:46:44.974217 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:44.974157 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-dtmqt" podStartSLOduration=1.822923208 podStartE2EDuration="4.974149901s" totalImagesPullingTime="3.151226693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:44.972945187 +0000 UTC m=+252.182258408" watchObservedRunningTime="2026-06-03 20:46:44.974149901 +0000 UTC m=+252.183463122" Jun 03 20:46:45.166421 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.166349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:46:45.166553 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:45.166515 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:46:45.166606 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:45.166592 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs podName:5e7bf515-83c9-4908-bc40-091d45e0f00a nodeName:}" failed. No retries permitted until 2026-06-03 20:48:47.166572078 +0000 UTC m=+374.375885282 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs") pod "network-metrics-daemon-h4mvp" (UID: "5e7bf515-83c9-4908-bc40-091d45e0f00a") : secret "metrics-daemon-secret" not found Jun 03 20:46:45.916901 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.916873 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/1.log" Jun 03 20:46:45.917397 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.917287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/0.log" Jun 03 20:46:45.917397 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.917319 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" containerID="ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7" exitCode=255 Jun 03 20:46:45.917502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.917423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" event={"ID":"9bfdc206-b0eb-40d8-a755-5d30a15ae819","Type":"ContainerDied","Data":"ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7"} Jun 03 20:46:45.917502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.917483 2560 scope.go:117] "RemoveContainer" containerID="c4a8d0e8333d1a2e68866948364879da9d127afb117f953189fd7e92bdbbd13a" Jun 03 20:46:45.917698 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:45.917683 2560 scope.go:117] "RemoveContainer" containerID="ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7" Jun 03 20:46:45.917910 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:45.917876 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-sjfdn_openshift-console-operator(9bfdc206-b0eb-40d8-a755-5d30a15ae819)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" podUID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" Jun 03 20:46:46.194984 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.194948 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs"] Jun 03 20:46:46.199653 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.198658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" Jun 03 20:46:46.201663 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.201635 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:46.201790 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.201757 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-72lhj\"" Jun 03 20:46:46.202068 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.202044 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 20:46:46.212164 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.212143 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs"] Jun 03 20:46:46.276886 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.276857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-888kj\" (UniqueName: \"kubernetes.io/projected/a3f9b8c4-716c-4041-a9d3-ee08579c3e38-kube-api-access-888kj\") pod \"migrator-955ffdf5f-rhnjs\" (UID: \"a3f9b8c4-716c-4041-a9d3-ee08579c3e38\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" Jun 03 20:46:46.377627 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.377595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-888kj\" (UniqueName: \"kubernetes.io/projected/a3f9b8c4-716c-4041-a9d3-ee08579c3e38-kube-api-access-888kj\") pod \"migrator-955ffdf5f-rhnjs\" (UID: \"a3f9b8c4-716c-4041-a9d3-ee08579c3e38\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" Jun 03 20:46:46.388327 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.388303 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-888kj\" (UniqueName: \"kubernetes.io/projected/a3f9b8c4-716c-4041-a9d3-ee08579c3e38-kube-api-access-888kj\") pod \"migrator-955ffdf5f-rhnjs\" (UID: \"a3f9b8c4-716c-4041-a9d3-ee08579c3e38\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" Jun 03 20:46:46.508663 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.508592 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" Jun 03 20:46:46.626318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.626221 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs"] Jun 03 20:46:46.628628 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:46:46.628600 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f9b8c4_716c_4041_a9d3_ee08579c3e38.slice/crio-c12cf0e58c9ca8254ef9bf77735f83dfe84c0a4e1c27143264a97fb1ec3daa63 WatchSource:0}: Error finding container c12cf0e58c9ca8254ef9bf77735f83dfe84c0a4e1c27143264a97fb1ec3daa63: Status 404 returned error can't find the container with id c12cf0e58c9ca8254ef9bf77735f83dfe84c0a4e1c27143264a97fb1ec3daa63 Jun 03 20:46:46.921171 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.921098 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/1.log" Jun 03 20:46:46.921592 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.921476 2560 scope.go:117] "RemoveContainer" containerID="ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7" Jun 03 20:46:46.921665 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:46.921643 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-sjfdn_openshift-console-operator(9bfdc206-b0eb-40d8-a755-5d30a15ae819)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" podUID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" Jun 03 20:46:46.922371 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:46.922353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" event={"ID":"a3f9b8c4-716c-4041-a9d3-ee08579c3e38","Type":"ContainerStarted","Data":"c12cf0e58c9ca8254ef9bf77735f83dfe84c0a4e1c27143264a97fb1ec3daa63"} Jun 03 20:46:47.927305 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:47.927252 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" event={"ID":"a3f9b8c4-716c-4041-a9d3-ee08579c3e38","Type":"ContainerStarted","Data":"9c5c460f22216157cf3170e091b2407e1bd7dafc20fe998b84af58a604f6cc02"} Jun 03 20:46:47.927760 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:47.927329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" event={"ID":"a3f9b8c4-716c-4041-a9d3-ee08579c3e38","Type":"ContainerStarted","Data":"92987049544a98017cee817e662e5d33a7e00d3d1346e8c6552050581b7c3504"} Jun 03 20:46:47.944193 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:47.944141 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rhnjs" podStartSLOduration=0.947375768 podStartE2EDuration="1.944126824s" totalImagesPullingTime="996.751056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:47.943341757 +0000 UTC m=+255.152654999" watchObservedRunningTime="2026-06-03 20:46:47.944126824 +0000 UTC m=+255.153440043" Jun 03 20:46:48.057768 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.057742 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2fplk"] Jun 03 20:46:48.060724 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.060707 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.063101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.063080 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 20:46:48.063198 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.063121 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 20:46:48.063198 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.063187 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 20:46:48.063333 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.063321 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4q8wc\"" Jun 03 20:46:48.063378 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.063344 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 20:46:48.072191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.072171 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2fplk"] Jun 03 20:46:48.092171 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.092147 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wl6j\" (UniqueName: \"kubernetes.io/projected/eff83f70-c878-4561-99a3-546ead3dc579-kube-api-access-4wl6j\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.092281 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.092201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eff83f70-c878-4561-99a3-546ead3dc579-signing-cabundle\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.092326 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.092299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eff83f70-c878-4561-99a3-546ead3dc579-signing-key\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.193076 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.193008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eff83f70-c878-4561-99a3-546ead3dc579-signing-cabundle\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.193164 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.193080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eff83f70-c878-4561-99a3-546ead3dc579-signing-key\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.193164 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.193122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wl6j\" (UniqueName: \"kubernetes.io/projected/eff83f70-c878-4561-99a3-546ead3dc579-kube-api-access-4wl6j\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.193761 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.193736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eff83f70-c878-4561-99a3-546ead3dc579-signing-cabundle\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.195445 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.195428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eff83f70-c878-4561-99a3-546ead3dc579-signing-key\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.201948 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.201923 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wl6j\" (UniqueName: \"kubernetes.io/projected/eff83f70-c878-4561-99a3-546ead3dc579-kube-api-access-4wl6j\") pod \"service-ca-7d74d578b8-2fplk\" (UID: \"eff83f70-c878-4561-99a3-546ead3dc579\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.294351 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.294322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:48.294485 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:48.294468 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:48.294534 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:48.294527 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls podName:b2552856-9965-4440-8ce3-a3b9a7a58eb9 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:56.294510271 +0000 UTC m=+263.503823479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-75ck8" (UID: "b2552856-9965-4440-8ce3-a3b9a7a58eb9") : secret "samples-operator-tls" not found Jun 03 20:46:48.369873 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.369844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" Jun 03 20:46:48.395087 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.395057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:48.395215 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:48.395200 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:48.395282 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:48.395272 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls podName:79d91fb2-d56d-4245-aefc-5877f67425ae nodeName:}" failed. No retries permitted until 2026-06-03 20:46:56.395244329 +0000 UTC m=+263.604557538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-bjjbx" (UID: "79d91fb2-d56d-4245-aefc-5877f67425ae") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:48.487753 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.487726 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2fplk"] Jun 03 20:46:48.490302 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:46:48.490277 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff83f70_c878_4561_99a3_546ead3dc579.slice/crio-171e87f7dda68123b649b8ea4dfac88afdbabd380ce4302b2b3ba5d9cdd16bd3 WatchSource:0}: Error finding container 171e87f7dda68123b649b8ea4dfac88afdbabd380ce4302b2b3ba5d9cdd16bd3: Status 404 returned error can't find the container with id 171e87f7dda68123b649b8ea4dfac88afdbabd380ce4302b2b3ba5d9cdd16bd3 Jun 03 20:46:48.877651 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.877545 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bq8cm_0a6847a3-4509-4a13-80bf-85dd8124be10/dns-node-resolver/0.log" Jun 03 20:46:48.932322 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.932292 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" event={"ID":"eff83f70-c878-4561-99a3-546ead3dc579","Type":"ContainerStarted","Data":"a1c3d44cac40c9a438b510fae4f778952f7034fe9ca3d6a89c02429af5d6e43c"} Jun 03 20:46:48.932891 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.932346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" event={"ID":"eff83f70-c878-4561-99a3-546ead3dc579","Type":"ContainerStarted","Data":"171e87f7dda68123b649b8ea4dfac88afdbabd380ce4302b2b3ba5d9cdd16bd3"} Jun 03 20:46:48.952983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:48.952930 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-2fplk" podStartSLOduration=0.952910457 podStartE2EDuration="952.910457ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:48.951375329 +0000 UTC m=+256.160688549" watchObservedRunningTime="2026-06-03 20:46:48.952910457 +0000 UTC m=+256.162223678" Jun 03 20:46:50.269006 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:50.268976 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vpmsl_1e19f7ae-dc41-4e49-b49b-03b8717d2aba/node-ca/0.log" Jun 03 20:46:50.668716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:50.668677 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xpjb_73828f80-e5e7-42ff-9316-2d044649c38a/serve-healthcheck-canary/0.log" Jun 03 20:46:50.920059 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:50.919981 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:50.920059 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:50.920062 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:46:50.920415 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:50.920401 2560 scope.go:117] "RemoveContainer" containerID="ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7" Jun 03 20:46:50.920563 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:50.920543 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-sjfdn_openshift-console-operator(9bfdc206-b0eb-40d8-a755-5d30a15ae819)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" podUID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" Jun 03 20:46:51.269406 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:51.269361 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rhnjs_a3f9b8c4-716c-4041-a9d3-ee08579c3e38/migrator/0.log" Jun 03 20:46:51.468528 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:51.468504 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rhnjs_a3f9b8c4-716c-4041-a9d3-ee08579c3e38/graceful-termination/0.log" Jun 03 20:46:51.671095 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:51.670998 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2_c7c359a9-87d0-45bc-a248-c71737339828/kube-storage-version-migrator-operator/0.log" Jun 03 20:46:56.368153 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:56.368069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:56.370418 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:56.370397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2552856-9965-4440-8ce3-a3b9a7a58eb9-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-75ck8\" (UID: \"b2552856-9965-4440-8ce3-a3b9a7a58eb9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:56.468944 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:56.468905 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:46:56.469107 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:56.469048 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:56.469149 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:46:56.469110 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls podName:79d91fb2-d56d-4245-aefc-5877f67425ae nodeName:}" failed. No retries permitted until 2026-06-03 20:47:12.469094567 +0000 UTC m=+279.678407765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-bjjbx" (UID: "79d91fb2-d56d-4245-aefc-5877f67425ae") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:56.527939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:56.527904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" Jun 03 20:46:56.650695 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:56.650622 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8"] Jun 03 20:46:56.958156 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:56.958119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" event={"ID":"b2552856-9965-4440-8ce3-a3b9a7a58eb9","Type":"ContainerStarted","Data":"28780382d3c7672b489ed12386789433b75ac0cd18538b41f9f90d925a6c9a76"} Jun 03 20:46:58.967698 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:58.967663 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" event={"ID":"b2552856-9965-4440-8ce3-a3b9a7a58eb9","Type":"ContainerStarted","Data":"e1cf3e7074cdd514df3a9d12e6677e126fa0d5da2b11a9a07547e0820335b7f7"} Jun 03 20:46:58.968074 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:58.967728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" event={"ID":"b2552856-9965-4440-8ce3-a3b9a7a58eb9","Type":"ContainerStarted","Data":"de98be8560af1a40bd54cc7ab174a6d3b1a3e00b881d25d95653e5e20823654e"} Jun 03 20:46:58.983074 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:46:58.983028 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-75ck8" podStartSLOduration=17.562149921 podStartE2EDuration="18.983014774s" totalImagesPullingTime="1.420864853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:58.982815378 +0000 UTC m=+266.192128598" watchObservedRunningTime="2026-06-03 20:46:58.983014774 +0000 UTC m=+266.192327993" Jun 03 20:47:03.211968 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.211941 2560 scope.go:117] "RemoveContainer" containerID="ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7" Jun 03 20:47:03.984242 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.984217 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:47:03.984582 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.984567 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/1.log" Jun 03 20:47:03.984634 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.984603 2560 generic.go:356] "Generic (PLEG): container finished" podID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" containerID="57f3ca9c37391d1dfe6c0ac67a4ac85e5c4693940e938ad6f0dd7fe0e34c10d1" exitCode=255 Jun 03 20:47:03.984671 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.984644 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" event={"ID":"9bfdc206-b0eb-40d8-a755-5d30a15ae819","Type":"ContainerDied","Data":"57f3ca9c37391d1dfe6c0ac67a4ac85e5c4693940e938ad6f0dd7fe0e34c10d1"} Jun 03 20:47:03.984704 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.984692 2560 scope.go:117] "RemoveContainer" containerID="ad0125c0cae72301cdb91ef4fb48164f98cb37a7bc8ce52e16d01e3035b80cc7" Jun 03 20:47:03.985064 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:03.985047 2560 scope.go:117] "RemoveContainer" containerID="57f3ca9c37391d1dfe6c0ac67a4ac85e5c4693940e938ad6f0dd7fe0e34c10d1" Jun 03 20:47:03.985244 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:47:03.985217 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-sjfdn_openshift-console-operator(9bfdc206-b0eb-40d8-a755-5d30a15ae819)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" podUID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" Jun 03 20:47:04.988734 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:04.988708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:47:07.583144 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.583112 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wl2zd"] Jun 03 20:47:07.587995 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.587973 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.591182 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.591150 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 20:47:07.591369 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.591192 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 20:47:07.591943 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.591926 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6s5xw\"" Jun 03 20:47:07.598807 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.598786 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wl2zd"] Jun 03 20:47:07.656715 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.656686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klp25\" (UniqueName: \"kubernetes.io/projected/8b663d54-0f5d-4b6c-9268-b3787482baf3-kube-api-access-klp25\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.656884 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.656731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b663d54-0f5d-4b6c-9268-b3787482baf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.656884 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.656757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b663d54-0f5d-4b6c-9268-b3787482baf3-data-volume\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.656884 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.656810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b663d54-0f5d-4b6c-9268-b3787482baf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.657006 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.656893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b663d54-0f5d-4b6c-9268-b3787482baf3-crio-socket\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757388 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klp25\" (UniqueName: \"kubernetes.io/projected/8b663d54-0f5d-4b6c-9268-b3787482baf3-kube-api-access-klp25\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757544 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b663d54-0f5d-4b6c-9268-b3787482baf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757544 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b663d54-0f5d-4b6c-9268-b3787482baf3-data-volume\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757544 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b663d54-0f5d-4b6c-9268-b3787482baf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757544 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b663d54-0f5d-4b6c-9268-b3787482baf3-crio-socket\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757610 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b663d54-0f5d-4b6c-9268-b3787482baf3-crio-socket\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.757836 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.757817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b663d54-0f5d-4b6c-9268-b3787482baf3-data-volume\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.758087 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.758068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b663d54-0f5d-4b6c-9268-b3787482baf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.759808 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.759788 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b663d54-0f5d-4b6c-9268-b3787482baf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.767187 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.767168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klp25\" (UniqueName: \"kubernetes.io/projected/8b663d54-0f5d-4b6c-9268-b3787482baf3-kube-api-access-klp25\") pod \"insights-runtime-extractor-wl2zd\" (UID: \"8b663d54-0f5d-4b6c-9268-b3787482baf3\") " pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:07.897110 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:07.897045 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wl2zd" Jun 03 20:47:08.042923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:08.042849 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wl2zd"] Jun 03 20:47:08.045331 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:08.045304 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b663d54_0f5d_4b6c_9268_b3787482baf3.slice/crio-22b38bf1054dd30920776880b670012606bd07c42ae4e625204047539f6c8a02 WatchSource:0}: Error finding container 22b38bf1054dd30920776880b670012606bd07c42ae4e625204047539f6c8a02: Status 404 returned error can't find the container with id 22b38bf1054dd30920776880b670012606bd07c42ae4e625204047539f6c8a02 Jun 03 20:47:09.009144 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:09.009069 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl2zd" event={"ID":"8b663d54-0f5d-4b6c-9268-b3787482baf3","Type":"ContainerStarted","Data":"2ad0504ec8824813d88d6a625bc8160aab739177e2bbf79fc8fad779ce57f707"} Jun 03 20:47:09.009144 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:09.009122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl2zd" event={"ID":"8b663d54-0f5d-4b6c-9268-b3787482baf3","Type":"ContainerStarted","Data":"422aa404fa6ec3b657656ba4018a7f9e41809d44097c374684c122cedd75ae95"} Jun 03 20:47:09.009144 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:09.009140 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl2zd" event={"ID":"8b663d54-0f5d-4b6c-9268-b3787482baf3","Type":"ContainerStarted","Data":"22b38bf1054dd30920776880b670012606bd07c42ae4e625204047539f6c8a02"} Jun 03 20:47:10.920364 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:10.920329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:47:10.920872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:10.920394 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:47:10.920872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:10.920766 2560 scope.go:117] "RemoveContainer" containerID="57f3ca9c37391d1dfe6c0ac67a4ac85e5c4693940e938ad6f0dd7fe0e34c10d1" Jun 03 20:47:10.921013 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:47:10.920989 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-sjfdn_openshift-console-operator(9bfdc206-b0eb-40d8-a755-5d30a15ae819)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" podUID="9bfdc206-b0eb-40d8-a755-5d30a15ae819" Jun 03 20:47:11.017776 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:11.017738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl2zd" event={"ID":"8b663d54-0f5d-4b6c-9268-b3787482baf3","Type":"ContainerStarted","Data":"1765bcf9144af425fee4dc56707f142ffc908d772bbdbaccae2ee11f7644f0fb"} Jun 03 20:47:11.035636 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:11.035594 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wl2zd" podStartSLOduration=1.897350974 podStartE2EDuration="4.035578964s" totalImagesPullingTime="2.13822799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:11.034600563 +0000 UTC m=+278.243913783" watchObservedRunningTime="2026-06-03 20:47:11.035578964 +0000 UTC m=+278.244892183" Jun 03 20:47:12.494803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:12.494748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:47:12.497149 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:12.497130 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79d91fb2-d56d-4245-aefc-5877f67425ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-bjjbx\" (UID: \"79d91fb2-d56d-4245-aefc-5877f67425ae\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:47:12.524543 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:12.524519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" Jun 03 20:47:12.646187 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:12.646154 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx"] Jun 03 20:47:12.648983 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:12.648959 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d91fb2_d56d_4245_aefc_5877f67425ae.slice/crio-1ef3b15fac046063d287cafcd64f4661dc3f8ebb696803741911a4c6c16b7738 WatchSource:0}: Error finding container 1ef3b15fac046063d287cafcd64f4661dc3f8ebb696803741911a4c6c16b7738: Status 404 returned error can't find the container with id 1ef3b15fac046063d287cafcd64f4661dc3f8ebb696803741911a4c6c16b7738 Jun 03 20:47:13.024923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:13.024883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" event={"ID":"79d91fb2-d56d-4245-aefc-5877f67425ae","Type":"ContainerStarted","Data":"1ef3b15fac046063d287cafcd64f4661dc3f8ebb696803741911a4c6c16b7738"} Jun 03 20:47:13.676328 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:47:13.676283 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" Jun 03 20:47:13.676662 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:47:13.676283 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vcmwk" podUID="549b6c66-e747-4da5-b0ff-df490e1990e2" Jun 03 20:47:14.028568 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:14.028487 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:47:14.028736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:14.028487 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcmwk" Jun 03 20:47:15.032861 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:15.032821 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" event={"ID":"79d91fb2-d56d-4245-aefc-5877f67425ae","Type":"ContainerStarted","Data":"bed8354f3ba4417637a63ffc07aaeef0ca07c594cce3f70ced7fe7762213ddec"} Jun 03 20:47:15.050102 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:15.050057 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-bjjbx" podStartSLOduration=33.504077329 podStartE2EDuration="35.050044495s" totalImagesPullingTime="1.545967166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:15.049062857 +0000 UTC m=+282.258376096" watchObservedRunningTime="2026-06-03 20:47:15.050044495 +0000 UTC m=+282.259357715" Jun 03 20:47:17.133321 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.133249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:47:17.135640 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.135621 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"image-registry-66858f68bb-rlt2v\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:47:17.234244 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.234212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:47:17.234432 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.234296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:47:17.236527 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.236502 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/549b6c66-e747-4da5-b0ff-df490e1990e2-metrics-tls\") pod \"dns-default-vcmwk\" (UID: \"549b6c66-e747-4da5-b0ff-df490e1990e2\") " pod="openshift-dns/dns-default-vcmwk" Jun 03 20:47:17.236767 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.236745 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3414b686-fce4-45f7-b17d-f166e77a1421-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-pbt2c\" (UID: \"3414b686-fce4-45f7-b17d-f166e77a1421\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:47:17.332820 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.332786 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gs868\"" Jun 03 20:47:17.332820 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.332786 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v2mx4\"" Jun 03 20:47:17.340670 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.340646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:47:17.340762 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.340743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcmwk" Jun 03 20:47:17.415634 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.415225 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r9tvb\"" Jun 03 20:47:17.423156 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.423131 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" Jun 03 20:47:17.481858 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.481798 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vcmwk"] Jun 03 20:47:17.485803 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:17.485767 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549b6c66_e747_4da5_b0ff_df490e1990e2.slice/crio-f95e0c22fb9e2dead741a369c957dd9731ebe5432df75a1b5e2deb8cecb5f551 WatchSource:0}: Error finding container f95e0c22fb9e2dead741a369c957dd9731ebe5432df75a1b5e2deb8cecb5f551: Status 404 returned error can't find the container with id f95e0c22fb9e2dead741a369c957dd9731ebe5432df75a1b5e2deb8cecb5f551 Jun 03 20:47:17.499275 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.499234 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66858f68bb-rlt2v"] Jun 03 20:47:17.501494 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:17.501467 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f04d06a_9839_4bbd_b704_d44af730434d.slice/crio-36473299dc5e9193e4e855922c6705bedcaea97f1498d4aa8a0ff753ac38d6c6 WatchSource:0}: Error finding container 36473299dc5e9193e4e855922c6705bedcaea97f1498d4aa8a0ff753ac38d6c6: Status 404 returned error can't find the container with id 36473299dc5e9193e4e855922c6705bedcaea97f1498d4aa8a0ff753ac38d6c6 Jun 03 20:47:17.556861 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:17.556837 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-pbt2c"] Jun 03 20:47:17.559687 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:17.559653 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3414b686_fce4_45f7_b17d_f166e77a1421.slice/crio-72bc04b465c0caea404d4871a0fb882ecc9bb2c5377f0851e92095ab32a6e317 WatchSource:0}: Error finding container 72bc04b465c0caea404d4871a0fb882ecc9bb2c5377f0851e92095ab32a6e317: Status 404 returned error can't find the container with id 72bc04b465c0caea404d4871a0fb882ecc9bb2c5377f0851e92095ab32a6e317 Jun 03 20:47:18.048158 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:18.048118 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" event={"ID":"3414b686-fce4-45f7-b17d-f166e77a1421","Type":"ContainerStarted","Data":"72bc04b465c0caea404d4871a0fb882ecc9bb2c5377f0851e92095ab32a6e317"} Jun 03 20:47:18.049491 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:18.049461 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vcmwk" event={"ID":"549b6c66-e747-4da5-b0ff-df490e1990e2","Type":"ContainerStarted","Data":"f95e0c22fb9e2dead741a369c957dd9731ebe5432df75a1b5e2deb8cecb5f551"} Jun 03 20:47:18.051205 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:18.051179 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" event={"ID":"7f04d06a-9839-4bbd-b704-d44af730434d","Type":"ContainerStarted","Data":"6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708"} Jun 03 20:47:18.051390 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:18.051373 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" event={"ID":"7f04d06a-9839-4bbd-b704-d44af730434d","Type":"ContainerStarted","Data":"36473299dc5e9193e4e855922c6705bedcaea97f1498d4aa8a0ff753ac38d6c6"} Jun 03 20:47:18.051509 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:18.051496 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:47:20.058974 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:20.058941 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" event={"ID":"3414b686-fce4-45f7-b17d-f166e77a1421","Type":"ContainerStarted","Data":"b8bd9843ad7b86f812c9cab046151ea059a1f7dbf37e695676a58227df6fad6b"} Jun 03 20:47:20.075465 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:20.075422 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-pbt2c" podStartSLOduration=276.571068897 podStartE2EDuration="4m38.075408799s" totalImagesPullingTime="1.504339902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:20.074560847 +0000 UTC m=+287.283874066" watchObservedRunningTime="2026-06-03 20:47:20.075408799 +0000 UTC m=+287.284722067" Jun 03 20:47:20.075806 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:20.075781 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" podStartSLOduration=287.075772643 podStartE2EDuration="4m47.075772643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:18.072069038 +0000 UTC m=+285.281382263" watchObservedRunningTime="2026-06-03 20:47:20.075772643 +0000 UTC m=+287.285085862" Jun 03 20:47:21.063845 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:21.063809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vcmwk" event={"ID":"549b6c66-e747-4da5-b0ff-df490e1990e2","Type":"ContainerStarted","Data":"bd3acae7d21eee6f6d3eabba955fd225848554029baca0ba31f3ca4d850a8dda"} Jun 03 20:47:21.064277 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:21.063868 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vcmwk" event={"ID":"549b6c66-e747-4da5-b0ff-df490e1990e2","Type":"ContainerStarted","Data":"9fd6bd0d332069362a6e96a5317c6556ea71641cdd97f3ad6a1116cdfd4b55f7"} Jun 03 20:47:21.064277 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:21.064043 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vcmwk" Jun 03 20:47:21.080945 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:21.080900 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vcmwk" podStartSLOduration=251.352578736 podStartE2EDuration="4m14.080884356s" totalImagesPullingTime="2.72830562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:21.079076093 +0000 UTC m=+288.288389312" watchObservedRunningTime="2026-06-03 20:47:21.080884356 +0000 UTC m=+288.290197576" Jun 03 20:47:22.086174 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.086145 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4gd22"] Jun 03 20:47:22.089192 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.089173 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.091706 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.091409 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 20:47:22.091706 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.091505 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pw9s7\"" Jun 03 20:47:22.092210 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.092189 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 20:47:22.092342 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.092290 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 20:47:22.092403 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.092294 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 20:47:22.173450 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngm9\" (UniqueName: \"kubernetes.io/projected/7b565208-0e10-4eeb-bbef-1089258411ef-kube-api-access-9ngm9\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173608 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173485 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-wtmp\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173608 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173731 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173731 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-root\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173731 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173709 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-tls\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b565208-0e10-4eeb-bbef-1089258411ef-metrics-client-ca\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173760 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-sys\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.173872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.173797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-textfile\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275017 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.274986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-wtmp\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275178 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275178 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275178 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275096 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-root\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275178 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-tls\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275178 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b565208-0e10-4eeb-bbef-1089258411ef-metrics-client-ca\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275178 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-sys\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275416 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275184 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-wtmp\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275416 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275247 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-sys\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275416 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275305 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b565208-0e10-4eeb-bbef-1089258411ef-root\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275541 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-textfile\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275541 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngm9\" (UniqueName: \"kubernetes.io/projected/7b565208-0e10-4eeb-bbef-1089258411ef-kube-api-access-9ngm9\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275796 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275775 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-textfile\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275888 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b565208-0e10-4eeb-bbef-1089258411ef-metrics-client-ca\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.275888 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.275778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.277610 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.277585 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.277755 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.277739 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b565208-0e10-4eeb-bbef-1089258411ef-node-exporter-tls\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.284278 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.284241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngm9\" (UniqueName: \"kubernetes.io/projected/7b565208-0e10-4eeb-bbef-1089258411ef-kube-api-access-9ngm9\") pod \"node-exporter-4gd22\" (UID: \"7b565208-0e10-4eeb-bbef-1089258411ef\") " pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.401026 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:22.400951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4gd22" Jun 03 20:47:22.412587 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:22.412556 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b565208_0e10_4eeb_bbef_1089258411ef.slice/crio-558277152a713c130c873f8b214314b7fd6b10bb27533cda7c3ac66b27560dcb WatchSource:0}: Error finding container 558277152a713c130c873f8b214314b7fd6b10bb27533cda7c3ac66b27560dcb: Status 404 returned error can't find the container with id 558277152a713c130c873f8b214314b7fd6b10bb27533cda7c3ac66b27560dcb Jun 03 20:47:23.073466 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:23.073430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gd22" event={"ID":"7b565208-0e10-4eeb-bbef-1089258411ef","Type":"ContainerStarted","Data":"558277152a713c130c873f8b214314b7fd6b10bb27533cda7c3ac66b27560dcb"} Jun 03 20:47:24.078374 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:24.078337 2560 generic.go:356] "Generic (PLEG): container finished" podID="7b565208-0e10-4eeb-bbef-1089258411ef" containerID="0d266af3af18e63738e15d8166b5a970f3d3cc40048349fa6522a7f44e4b13f3" exitCode=0 Jun 03 20:47:24.078759 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:24.078407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gd22" event={"ID":"7b565208-0e10-4eeb-bbef-1089258411ef","Type":"ContainerDied","Data":"0d266af3af18e63738e15d8166b5a970f3d3cc40048349fa6522a7f44e4b13f3"} Jun 03 20:47:24.210231 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:24.210212 2560 scope.go:117] "RemoveContainer" containerID="57f3ca9c37391d1dfe6c0ac67a4ac85e5c4693940e938ad6f0dd7fe0e34c10d1" Jun 03 20:47:25.084249 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.084218 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:47:25.084695 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.084342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" event={"ID":"9bfdc206-b0eb-40d8-a755-5d30a15ae819","Type":"ContainerStarted","Data":"ffc1a427d046ab1d21bd147752b0de83715b9cef314214936efcc5ba2e8c908a"} Jun 03 20:47:25.084695 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.084611 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:47:25.087085 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.087059 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gd22" event={"ID":"7b565208-0e10-4eeb-bbef-1089258411ef","Type":"ContainerStarted","Data":"c3c7d596877a6225944fe17daf6cc5a2b7180be38785c45faef213f9b3d719f3"} Jun 03 20:47:25.087194 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.087108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gd22" event={"ID":"7b565208-0e10-4eeb-bbef-1089258411ef","Type":"ContainerStarted","Data":"bf49b0da14bbfe885c3cc88f79cdb5b40c4f18ce1c62baa8e593fe029caac498"} Jun 03 20:47:25.101869 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.101830 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" podStartSLOduration=41.724002264 podStartE2EDuration="45.101816221s" totalImagesPullingTime="3.377813957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:25.100835782 +0000 UTC m=+292.310149003" watchObservedRunningTime="2026-06-03 20:47:25.101816221 +0000 UTC m=+292.311129470" Jun 03 20:47:25.118539 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.118498 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4gd22" podStartSLOduration=2.12662994 podStartE2EDuration="3.11848517s" totalImagesPullingTime="926.422049ms" totalInitContainerRuntime="65.433181ms" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:25.117515985 +0000 UTC m=+292.326829204" watchObservedRunningTime="2026-06-03 20:47:25.11848517 +0000 UTC m=+292.327798389" Jun 03 20:47:25.133359 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:25.133329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-sjfdn" Jun 03 20:47:26.392566 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.392533 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n"] Jun 03 20:47:26.395869 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.395850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.399255 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.399226 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-26eovb0rn0qsg\"" Jun 03 20:47:26.399255 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.399247 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 20:47:26.399438 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.399250 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2ffh5\"" Jun 03 20:47:26.399438 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.399321 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 20:47:26.399438 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.399226 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 20:47:26.399438 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.399326 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 20:47:26.407453 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.407433 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n"] Jun 03 20:47:26.509723 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb8d734-8966-45de-ac18-87047893f4ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.509723 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aeb8d734-8966-45de-ac18-87047893f4ed-audit-log\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.509973 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-secret-metrics-server-client-certs\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.509973 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509825 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-secret-metrics-server-tls\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.509973 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfdd\" (UniqueName: \"kubernetes.io/projected/aeb8d734-8966-45de-ac18-87047893f4ed-kube-api-access-8dfdd\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.509973 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aeb8d734-8966-45de-ac18-87047893f4ed-metrics-server-audit-profiles\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.510112 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.509991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-client-ca-bundle\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610790 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aeb8d734-8966-45de-ac18-87047893f4ed-metrics-server-audit-profiles\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610790 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-client-ca-bundle\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610990 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb8d734-8966-45de-ac18-87047893f4ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610990 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aeb8d734-8966-45de-ac18-87047893f4ed-audit-log\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610990 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-secret-metrics-server-client-certs\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610990 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-secret-metrics-server-tls\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.610990 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.610907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfdd\" (UniqueName: \"kubernetes.io/projected/aeb8d734-8966-45de-ac18-87047893f4ed-kube-api-access-8dfdd\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.611282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.611242 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aeb8d734-8966-45de-ac18-87047893f4ed-audit-log\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.611601 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.611575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb8d734-8966-45de-ac18-87047893f4ed-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.611895 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.611869 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aeb8d734-8966-45de-ac18-87047893f4ed-metrics-server-audit-profiles\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.617874 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.613706 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-secret-metrics-server-tls\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.617874 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.613905 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-client-ca-bundle\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.617874 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.613919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aeb8d734-8966-45de-ac18-87047893f4ed-secret-metrics-server-client-certs\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.620960 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.620937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfdd\" (UniqueName: \"kubernetes.io/projected/aeb8d734-8966-45de-ac18-87047893f4ed-kube-api-access-8dfdd\") pod \"metrics-server-5bc77f4dcc-7dm4n\" (UID: \"aeb8d734-8966-45de-ac18-87047893f4ed\") " pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.705097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.705065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:26.838303 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:26.838253 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n"] Jun 03 20:47:26.841285 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:26.841245 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb8d734_8966_45de_ac18_87047893f4ed.slice/crio-e4ace74aabe04798196650437a2e11c2472890847a9df72f8aee09a3432b8d9a WatchSource:0}: Error finding container e4ace74aabe04798196650437a2e11c2472890847a9df72f8aee09a3432b8d9a: Status 404 returned error can't find the container with id e4ace74aabe04798196650437a2e11c2472890847a9df72f8aee09a3432b8d9a Jun 03 20:47:27.095813 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:27.095731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" event={"ID":"aeb8d734-8966-45de-ac18-87047893f4ed","Type":"ContainerStarted","Data":"e4ace74aabe04798196650437a2e11c2472890847a9df72f8aee09a3432b8d9a"} Jun 03 20:47:28.211954 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:47:28.211911 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h4mvp" podUID="5e7bf515-83c9-4908-bc40-091d45e0f00a" Jun 03 20:47:28.246482 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.246458 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:47:28.249948 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.249928 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.251937 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.251918 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 20:47:28.252230 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252203 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 20:47:28.252230 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252219 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 20:47:28.252405 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252386 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 20:47:28.252471 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252387 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 20:47:28.252471 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252444 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 20:47:28.252691 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252676 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 20:47:28.252751 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252686 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 20:47:28.252860 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252841 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 20:47:28.252948 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.252932 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 20:47:28.253058 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.253041 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 20:47:28.253425 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.253399 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 20:47:28.253425 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.253421 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-clvq7\"" Jun 03 20:47:28.253578 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.253403 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8qi36q1gl2tg0\"" Jun 03 20:47:28.253878 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.253859 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 20:47:28.256123 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.256106 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 20:47:28.266883 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.266855 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:47:28.427837 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.427804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.427837 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.427842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.427860 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.427884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.427906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.427971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2vjq\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-kube-api-access-f2vjq\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428097 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-config\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428329 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.428502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.428349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529183 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529183 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529147 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529183 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2vjq\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-kube-api-access-f2vjq\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-config\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529650 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.529939 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.529696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.530305 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.530071 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.530368 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.530329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.530578 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.530446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.531693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.531393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.531693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.531475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.531847 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.531738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.532656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.532372 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.533038 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.533012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.534045 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.534018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.534158 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.534137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.534657 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.534615 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.534900 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.534876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.535168 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.535147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.535364 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.535342 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.535803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.535779 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.535912 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.535825 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.535912 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.535855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-config\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.536039 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.536000 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.537033 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.537014 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.538413 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.538393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2vjq\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-kube-api-access-f2vjq\") pod \"prometheus-k8s-0\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.559460 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.559435 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:28.716460 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:28.716364 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:47:28.722737 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:47:28.722711 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d89e05_8d69_4670_9652_0168a8643a0e.slice/crio-ecddcf5ea225ea0eebb07e608d133ae6f4838710e83f0f8f9e4c9e7fb17ed1e6 WatchSource:0}: Error finding container ecddcf5ea225ea0eebb07e608d133ae6f4838710e83f0f8f9e4c9e7fb17ed1e6: Status 404 returned error can't find the container with id ecddcf5ea225ea0eebb07e608d133ae6f4838710e83f0f8f9e4c9e7fb17ed1e6 Jun 03 20:47:29.105101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:29.105049 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" event={"ID":"aeb8d734-8966-45de-ac18-87047893f4ed","Type":"ContainerStarted","Data":"a7964943194348935348498701a8ede6a1db405158b48ab567a585e862c70fb7"} Jun 03 20:47:29.106497 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:29.106470 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"ecddcf5ea225ea0eebb07e608d133ae6f4838710e83f0f8f9e4c9e7fb17ed1e6"} Jun 03 20:47:30.111669 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:30.111629 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" exitCode=0 Jun 03 20:47:30.112060 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:30.111712 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} Jun 03 20:47:30.141694 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:30.141651 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" podStartSLOduration=2.791303637 podStartE2EDuration="4.141636792s" totalImagesPullingTime="1.350333155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:29.123493292 +0000 UTC m=+296.332806505" watchObservedRunningTime="2026-06-03 20:47:30.141636792 +0000 UTC m=+297.350950011" Jun 03 20:47:31.070719 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:31.070691 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vcmwk" Jun 03 20:47:33.191498 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:33.191478 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:47:33.192743 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:33.192720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:47:33.203148 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:33.203038 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 20:47:34.129050 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:34.129015 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} Jun 03 20:47:34.129229 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:34.129080 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} Jun 03 20:47:36.140282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:36.140235 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} Jun 03 20:47:36.140738 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:36.140336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} Jun 03 20:47:36.140738 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:36.140365 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} Jun 03 20:47:36.140738 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:36.140394 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerStarted","Data":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} Jun 03 20:47:36.170294 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:36.170219 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.990449601 podStartE2EDuration="8.170200212s" totalImagesPullingTime="6.161201772s" totalInitContainerRuntime="18.548839ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:36.168191176 +0000 UTC m=+303.377504420" watchObservedRunningTime="2026-06-03 20:47:36.170200212 +0000 UTC m=+303.379513432" Jun 03 20:47:37.345019 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:37.344986 2560 patch_prober.go:28] interesting pod/image-registry-66858f68bb-rlt2v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:37.345378 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:37.345044 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:38.559798 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:38.559762 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:39.058580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:39.058553 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:47:40.913273 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:40.913240 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66858f68bb-rlt2v"] Jun 03 20:47:43.212569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:43.212530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:47:46.705193 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:46.705156 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:46.705569 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:46.705243 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:47:56.212780 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:56.212740 2560 generic.go:356] "Generic (PLEG): container finished" podID="b6815212-41bf-49f5-9e90-d676cfc64884" containerID="d5158660bd64c2f6e0514120cc217a2e48ff3a71229f505e82d6066c10652a06" exitCode=0 Jun 03 20:47:56.213282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:56.212799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-dtmqt" event={"ID":"b6815212-41bf-49f5-9e90-d676cfc64884","Type":"ContainerDied","Data":"d5158660bd64c2f6e0514120cc217a2e48ff3a71229f505e82d6066c10652a06"} Jun 03 20:47:56.213282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:56.213080 2560 scope.go:117] "RemoveContainer" containerID="d5158660bd64c2f6e0514120cc217a2e48ff3a71229f505e82d6066c10652a06" Jun 03 20:47:56.790103 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:56.790067 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xpjb_73828f80-e5e7-42ff-9316-2d044649c38a/serve-healthcheck-canary/0.log" Jun 03 20:47:57.217399 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:47:57.217368 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-dtmqt" event={"ID":"b6815212-41bf-49f5-9e90-d676cfc64884","Type":"ContainerStarted","Data":"c9c0b6de316fc778eb039cbaa5d5cebdc0dc520d407560b08da87e1b6b7fbdbe"} Jun 03 20:48:05.934397 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:05.934328 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" containerName="registry" containerID="cri-o://6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708" gracePeriod=30 Jun 03 20:48:06.211660 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.211604 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:48:06.251663 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.251630 2560 generic.go:356] "Generic (PLEG): container finished" podID="162a2cd3-0796-4f76-b828-ac5aa4edb9e9" containerID="943dab9381d879f61e3805b2a9f91f51d37cb3ed8b54214f4f03f2b729dc5d08" exitCode=0 Jun 03 20:48:06.251815 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.251702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" event={"ID":"162a2cd3-0796-4f76-b828-ac5aa4edb9e9","Type":"ContainerDied","Data":"943dab9381d879f61e3805b2a9f91f51d37cb3ed8b54214f4f03f2b729dc5d08"} Jun 03 20:48:06.252068 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.252052 2560 scope.go:117] "RemoveContainer" containerID="943dab9381d879f61e3805b2a9f91f51d37cb3ed8b54214f4f03f2b729dc5d08" Jun 03 20:48:06.253049 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.252997 2560 generic.go:356] "Generic (PLEG): container finished" podID="7f04d06a-9839-4bbd-b704-d44af730434d" containerID="6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708" exitCode=0 Jun 03 20:48:06.253049 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.253036 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" Jun 03 20:48:06.253158 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.253036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" event={"ID":"7f04d06a-9839-4bbd-b704-d44af730434d","Type":"ContainerDied","Data":"6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708"} Jun 03 20:48:06.253158 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.253145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66858f68bb-rlt2v" event={"ID":"7f04d06a-9839-4bbd-b704-d44af730434d","Type":"ContainerDied","Data":"36473299dc5e9193e4e855922c6705bedcaea97f1498d4aa8a0ff753ac38d6c6"} Jun 03 20:48:06.253231 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.253168 2560 scope.go:117] "RemoveContainer" containerID="6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708" Jun 03 20:48:06.261810 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.261794 2560 scope.go:117] "RemoveContainer" containerID="6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708" Jun 03 20:48:06.262082 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:06.262058 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708\": container with ID starting with 6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708 not found: ID does not exist" containerID="6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708" Jun 03 20:48:06.262167 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.262092 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708"} err="failed to get container status \"6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708\": rpc error: code = NotFound desc = could not find container \"6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708\": container with ID starting with 6d1d9bf3b73d428d03320b6a9c43f7c35419727a32eed91e4b2c4d98ac3f8708 not found: ID does not exist" Jun 03 20:48:06.357686 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357664 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357812 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357715 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-trusted-ca\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357812 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357747 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpxjd\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-kube-api-access-xpxjd\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357812 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357783 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-registry-certificates\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357964 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357819 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-image-registry-private-configuration\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357964 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357852 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-bound-sa-token\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357964 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357899 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f04d06a-9839-4bbd-b704-d44af730434d-ca-trust-extracted\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.357964 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.357926 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-installation-pull-secrets\") pod \"7f04d06a-9839-4bbd-b704-d44af730434d\" (UID: \"7f04d06a-9839-4bbd-b704-d44af730434d\") " Jun 03 20:48:06.358697 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.358316 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:06.358697 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.358462 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:06.360339 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.360293 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:06.361363 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.361318 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-kube-api-access-xpxjd" (OuterVolumeSpecName: "kube-api-access-xpxjd") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "kube-api-access-xpxjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:06.361858 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.361832 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:06.361998 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.361862 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:06.362066 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.362024 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:06.372662 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.372635 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f04d06a-9839-4bbd-b704-d44af730434d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7f04d06a-9839-4bbd-b704-d44af730434d" (UID: "7f04d06a-9839-4bbd-b704-d44af730434d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:06.459016 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.458985 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-registry-certificates\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459016 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459010 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-image-registry-private-configuration\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459016 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459020 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-bound-sa-token\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459224 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459029 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f04d06a-9839-4bbd-b704-d44af730434d-ca-trust-extracted\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459224 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459038 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f04d06a-9839-4bbd-b704-d44af730434d-installation-pull-secrets\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459224 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459046 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-registry-tls\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459224 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459054 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f04d06a-9839-4bbd-b704-d44af730434d-trusted-ca\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.459224 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.459062 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpxjd\" (UniqueName: \"kubernetes.io/projected/7f04d06a-9839-4bbd-b704-d44af730434d-kube-api-access-xpxjd\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:06.575339 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.575301 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66858f68bb-rlt2v"] Jun 03 20:48:06.578721 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.578691 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66858f68bb-rlt2v"] Jun 03 20:48:06.710825 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.710803 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:48:06.714808 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:06.714785 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bc77f4dcc-7dm4n" Jun 03 20:48:07.216713 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:07.216679 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" path="/var/lib/kubelet/pods/7f04d06a-9839-4bbd-b704-d44af730434d/volumes" Jun 03 20:48:07.259446 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:07.259412 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-dn229" event={"ID":"162a2cd3-0796-4f76-b828-ac5aa4edb9e9","Type":"ContainerStarted","Data":"c76ffc184fd0fcc4e54e430d807fdd2778af6d394e51af57cc540910b5a75b68"} Jun 03 20:48:21.315927 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:21.315895 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7c359a9-87d0-45bc-a248-c71737339828" containerID="b3e14b1c83c6ffdb24f9c2c7537a858c2c625df5abd516fa30feb994eb430796" exitCode=0 Jun 03 20:48:21.316312 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:21.315967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" event={"ID":"c7c359a9-87d0-45bc-a248-c71737339828","Type":"ContainerDied","Data":"b3e14b1c83c6ffdb24f9c2c7537a858c2c625df5abd516fa30feb994eb430796"} Jun 03 20:48:21.316362 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:21.316328 2560 scope.go:117] "RemoveContainer" containerID="b3e14b1c83c6ffdb24f9c2c7537a858c2c625df5abd516fa30feb994eb430796" Jun 03 20:48:22.321499 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:22.321466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2" event={"ID":"c7c359a9-87d0-45bc-a248-c71737339828","Type":"ContainerStarted","Data":"914323a80bbe4cf642876334e35917c8613037909f6746a7e1315c0c4529b5e3"} Jun 03 20:48:28.560557 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:28.560503 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:28.579804 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:28.579781 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:29.361199 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:29.361171 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:46.633105 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633062 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:46.633614 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633478 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="prometheus" containerID="cri-o://f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" gracePeriod=600 Jun 03 20:48:46.633614 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633503 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="config-reloader" containerID="cri-o://5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" gracePeriod=600 Jun 03 20:48:46.633614 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633513 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" gracePeriod=600 Jun 03 20:48:46.633614 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633537 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy" containerID="cri-o://3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" gracePeriod=600 Jun 03 20:48:46.633614 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633480 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-web" containerID="cri-o://9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" gracePeriod=600 Jun 03 20:48:46.633614 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.633490 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="thanos-sidecar" containerID="cri-o://436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" gracePeriod=600 Jun 03 20:48:46.876919 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.876892 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:46.991339 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991311 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-web-config\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991339 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991342 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-db\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991364 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-config-out\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991390 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2vjq\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-kube-api-access-f2vjq\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991412 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-serving-certs-ca-bundle\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991447 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-metrics-client-ca\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991462 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-thanos-prometheus-http-client-file\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991480 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-metrics-client-certs\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991580 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991512 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-2\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.991923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991801 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.991923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991836 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.991923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991846 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.991923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991896 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-kubelet-serving-ca-bundle\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992129 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991936 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-tls\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992129 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.991992 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-tls-assets\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992129 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992022 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-grpc-tls\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992129 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992049 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-1\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992129 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992077 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-0\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992129 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992102 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-trusted-ca-bundle\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992133 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992160 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-kube-rbac-proxy\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992195 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992226 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-config\") pod \"b5d89e05-8d69-4670-9652-0168a8643a0e\" (UID: \"b5d89e05-8d69-4670-9652-0168a8643a0e\") " Jun 03 20:48:46.992555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992436 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:46.992803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992586 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:46.992803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992607 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-metrics-client-ca\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:46.992803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992625 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:46.992803 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.992639 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-db\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:46.994157 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.994094 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.994285 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.994238 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.994752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.994537 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.994752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.994601 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.994752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.994646 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-config-out" (OuterVolumeSpecName: "config-out") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:46.994752 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.994735 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-kube-api-access-f2vjq" (OuterVolumeSpecName: "kube-api-access-f2vjq") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "kube-api-access-f2vjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:46.995214 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.995176 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.995558 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.995447 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.995558 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.995526 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:46.995904 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.995882 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-config" (OuterVolumeSpecName: "config") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.995978 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.995958 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:46.996248 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.996228 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.996638 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.996617 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.996827 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.996801 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:46.997176 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:46.997157 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:47.004906 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.004888 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-web-config" (OuterVolumeSpecName: "web-config") pod "b5d89e05-8d69-4670-9652-0168a8643a0e" (UID: "b5d89e05-8d69-4670-9652-0168a8643a0e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:47.093121 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093092 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093121 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093118 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-metrics-client-certs\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093121 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093127 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093136 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093147 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-tls-assets\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093157 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-grpc-tls\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093165 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093175 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093183 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5d89e05-8d69-4670-9652-0168a8643a0e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093191 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093200 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-kube-rbac-proxy\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093209 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093218 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-config\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093225 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5d89e05-8d69-4670-9652-0168a8643a0e-web-config\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093233 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5d89e05-8d69-4670-9652-0168a8643a0e-config-out\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.093309 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.093241 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2vjq\" (UniqueName: \"kubernetes.io/projected/b5d89e05-8d69-4670-9652-0168a8643a0e-kube-api-access-f2vjq\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:48:47.194274 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.194239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:48:47.196417 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.196401 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7bf515-83c9-4908-bc40-091d45e0f00a-metrics-certs\") pod \"network-metrics-daemon-h4mvp\" (UID: \"5e7bf515-83c9-4908-bc40-091d45e0f00a\") " pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:48:47.412101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412019 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" exitCode=0 Jun 03 20:48:47.412101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412046 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" exitCode=0 Jun 03 20:48:47.412101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412052 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" exitCode=0 Jun 03 20:48:47.412101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412060 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" exitCode=0 Jun 03 20:48:47.412101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} Jun 03 20:48:47.412101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412099 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412068 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" exitCode=0 Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412145 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" exitCode=0 Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412149 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412186 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412198 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412223 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} Jun 03 20:48:47.412515 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.412246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5d89e05-8d69-4670-9652-0168a8643a0e","Type":"ContainerDied","Data":"ecddcf5ea225ea0eebb07e608d133ae6f4838710e83f0f8f9e4c9e7fb17ed1e6"} Jun 03 20:48:47.415004 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.414987 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg5sv\"" Jun 03 20:48:47.420230 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.420215 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.423151 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.423133 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h4mvp" Jun 03 20:48:47.427101 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.427083 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.432123 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.432103 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:47.434847 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.434829 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.437331 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.437309 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:47.441392 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.441370 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.448307 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.448289 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.455616 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.455596 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.461526 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461505 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:47.461799 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461787 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="config-reloader" Jun 03 20:48:47.461845 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461802 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="config-reloader" Jun 03 20:48:47.461845 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461815 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-web" Jun 03 20:48:47.461845 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461823 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-web" Jun 03 20:48:47.461845 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461835 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="init-config-reloader" Jun 03 20:48:47.461845 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461840 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="init-config-reloader" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461847 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="prometheus" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461853 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="prometheus" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461858 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461862 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461871 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="thanos-sidecar" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461876 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="thanos-sidecar" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461885 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-thanos" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461890 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-thanos" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461898 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" containerName="registry" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461903 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" containerName="registry" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461947 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="thanos-sidecar" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461953 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-web" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461960 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f04d06a-9839-4bbd-b704-d44af730434d" containerName="registry" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461965 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy-thanos" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461971 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="config-reloader" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461975 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="kube-rbac-proxy" Jun 03 20:48:47.462021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.461981 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" containerName="prometheus" Jun 03 20:48:47.462737 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.462711 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.463061 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.463040 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.463142 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463073 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} err="failed to get container status \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" Jun 03 20:48:47.463142 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463097 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.463365 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.463350 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.463409 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463374 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} err="failed to get container status \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" Jun 03 20:48:47.463409 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463395 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.463646 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.463617 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.463734 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463650 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} err="failed to get container status \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" Jun 03 20:48:47.463734 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463674 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.463951 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.463928 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.464008 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463958 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} err="failed to get container status \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" Jun 03 20:48:47.464008 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.463981 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.464431 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.464252 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.464431 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.464337 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} err="failed to get container status \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" Jun 03 20:48:47.464431 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.464357 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.464865 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.464846 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.464979 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.464872 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} err="failed to get container status \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" Jun 03 20:48:47.464979 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.464892 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.465203 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:48:47.465178 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.465405 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465218 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} err="failed to get container status \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" Jun 03 20:48:47.465405 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465239 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.465536 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465504 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} err="failed to get container status \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" Jun 03 20:48:47.465536 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.465613 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465521 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.465872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465843 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} err="failed to get container status \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" Jun 03 20:48:47.465872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.465871 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.466344 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.466321 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} err="failed to get container status \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" Jun 03 20:48:47.466344 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.466344 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.466601 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.466583 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} err="failed to get container status \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" Jun 03 20:48:47.466601 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.466601 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.466848 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.466825 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} err="failed to get container status \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" Jun 03 20:48:47.466935 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.466849 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.467109 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467084 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} err="failed to get container status \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" Jun 03 20:48:47.467182 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467111 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.467374 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467354 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} err="failed to get container status \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" Jun 03 20:48:47.467374 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467374 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.467694 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467664 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} err="failed to get container status \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" Jun 03 20:48:47.467694 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467685 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.468014 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.467979 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} err="failed to get container status \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" Jun 03 20:48:47.468108 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468019 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.468108 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468057 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 20:48:47.468108 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468057 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 20:48:47.468432 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468142 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 20:48:47.468432 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468346 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} err="failed to get container status \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" Jun 03 20:48:47.468432 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468376 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.468577 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468434 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 20:48:47.468577 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468509 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 20:48:47.468577 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468532 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 20:48:47.468577 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468539 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 20:48:47.468768 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468624 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 20:48:47.468858 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468828 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} err="failed to get container status \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" Jun 03 20:48:47.468942 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468861 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.468942 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468872 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8qi36q1gl2tg0\"" Jun 03 20:48:47.468942 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468877 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 20:48:47.468942 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.468894 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 20:48:47.470159 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.469880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-clvq7\"" Jun 03 20:48:47.472228 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.471936 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 20:48:47.472555 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.472538 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 20:48:47.479517 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.479040 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} err="failed to get container status \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" Jun 03 20:48:47.479517 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.479081 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.481069 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.481043 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} err="failed to get container status \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" Jun 03 20:48:47.481239 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.481221 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.482819 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.482795 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:47.482938 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.482843 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} err="failed to get container status \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" Jun 03 20:48:47.482938 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.482867 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.482938 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.482871 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 20:48:47.483417 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.483384 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} err="failed to get container status \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" Jun 03 20:48:47.483506 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.483418 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.483785 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.483757 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} err="failed to get container status \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" Jun 03 20:48:47.483854 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.483787 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.484207 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.484186 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} err="failed to get container status \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" Jun 03 20:48:47.484313 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.484285 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.484793 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.484718 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} err="failed to get container status \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" Jun 03 20:48:47.484793 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.484746 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.485082 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.485049 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} err="failed to get container status \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" Jun 03 20:48:47.485082 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.485074 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.485532 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.485496 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} err="failed to get container status \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" Jun 03 20:48:47.485693 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.485680 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.486120 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486043 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} err="failed to get container status \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" Jun 03 20:48:47.486120 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486067 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.486450 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486430 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} err="failed to get container status \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" Jun 03 20:48:47.486533 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486452 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.486720 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486700 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} err="failed to get container status \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" Jun 03 20:48:47.486796 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486721 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.486796 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.486768 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 20:48:47.487025 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487005 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} err="failed to get container status \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" Jun 03 20:48:47.487064 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487029 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.487375 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487357 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} err="failed to get container status \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" Jun 03 20:48:47.487434 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487377 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.487607 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487589 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} err="failed to get container status \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" Jun 03 20:48:47.487607 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487606 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.487936 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487912 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} err="failed to get container status \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" Jun 03 20:48:47.487993 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.487938 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.488857 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.488832 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} err="failed to get container status \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" Jun 03 20:48:47.488857 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.488857 2560 scope.go:117] "RemoveContainer" containerID="c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50" Jun 03 20:48:47.489199 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.489171 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50"} err="failed to get container status \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": rpc error: code = NotFound desc = could not find container \"c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50\": container with ID starting with c04512fa95baea9898d2be01910ee78c1714c49334fa8168635e9015c668be50 not found: ID does not exist" Jun 03 20:48:47.489304 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.489202 2560 scope.go:117] "RemoveContainer" containerID="3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9" Jun 03 20:48:47.489533 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.489512 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9"} err="failed to get container status \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": rpc error: code = NotFound desc = could not find container \"3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9\": container with ID starting with 3c8c165a694f2286bf3ecb58c1829ecb5f32fa383c5b4639d0b6139a5d2649c9 not found: ID does not exist" Jun 03 20:48:47.489591 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.489533 2560 scope.go:117] "RemoveContainer" containerID="9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66" Jun 03 20:48:47.489835 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.489812 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66"} err="failed to get container status \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": rpc error: code = NotFound desc = could not find container \"9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66\": container with ID starting with 9db3b107f26d4bb40ca4949196490cca8f77af83ac71e7b6dd0ea409deb3ad66 not found: ID does not exist" Jun 03 20:48:47.489891 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.489837 2560 scope.go:117] "RemoveContainer" containerID="436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c" Jun 03 20:48:47.490162 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.490138 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c"} err="failed to get container status \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": rpc error: code = NotFound desc = could not find container \"436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c\": container with ID starting with 436ecec8fddeba861baeb0ebfdcfeaa34bb8d22d36e297e55b8af00e433a1e7c not found: ID does not exist" Jun 03 20:48:47.490228 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.490164 2560 scope.go:117] "RemoveContainer" containerID="5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244" Jun 03 20:48:47.490522 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.490498 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244"} err="failed to get container status \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": rpc error: code = NotFound desc = could not find container \"5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244\": container with ID starting with 5dd73a715470ddd4e704afe0cd16be70945fa24850e11c21632394917020b244 not found: ID does not exist" Jun 03 20:48:47.490601 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.490523 2560 scope.go:117] "RemoveContainer" containerID="f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d" Jun 03 20:48:47.490811 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.490787 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d"} err="failed to get container status \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": rpc error: code = NotFound desc = could not find container \"f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d\": container with ID starting with f3cb10772cd510ea8670e008ee5497ccf3b47ce408f7b3924e790e8647bd2b1d not found: ID does not exist" Jun 03 20:48:47.490811 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.490811 2560 scope.go:117] "RemoveContainer" containerID="5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855" Jun 03 20:48:47.491046 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.491022 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855"} err="failed to get container status \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": rpc error: code = NotFound desc = could not find container \"5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855\": container with ID starting with 5f76ebf51a2cd5dce8734213cca9f48f3d787f6473393bfa31e0e9e448dff855 not found: ID does not exist" Jun 03 20:48:47.562716 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.562693 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h4mvp"] Jun 03 20:48:47.564928 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:48:47.564899 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7bf515_83c9_4908_bc40_091d45e0f00a.slice/crio-a4851e9a581d42f55ab22b1b073628a859ea8d878d70d5963276d4ff004de630 WatchSource:0}: Error finding container a4851e9a581d42f55ab22b1b073628a859ea8d878d70d5963276d4ff004de630: Status 404 returned error can't find the container with id a4851e9a581d42f55ab22b1b073628a859ea8d878d70d5963276d4ff004de630 Jun 03 20:48:47.566859 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.566840 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:48:47.597484 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597581 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597581 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597581 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597581 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-config\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1863550b-b2be-4a18-abab-77a15fdf2529-config-out\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597642 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbwmj\" (UniqueName: \"kubernetes.io/projected/1863550b-b2be-4a18-abab-77a15fdf2529-kube-api-access-kbwmj\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597781 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597853 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-web-config\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597885 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.597909 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.598154 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.597949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1863550b-b2be-4a18-abab-77a15fdf2529-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.698879 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.698781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.698927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.698955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-web-config\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.698976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.698993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1863550b-b2be-4a18-abab-77a15fdf2529-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-config\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1863550b-b2be-4a18-abab-77a15fdf2529-config-out\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699935 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699935 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699935 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbwmj\" (UniqueName: \"kubernetes.io/projected/1863550b-b2be-4a18-abab-77a15fdf2529-kube-api-access-kbwmj\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699935 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.699935 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699653 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.699953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.700641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.700669 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.700810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.700847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.700875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.702361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.702361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.702687 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.702687 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.703132 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.703083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1863550b-b2be-4a18-abab-77a15fdf2529-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.703782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.703592 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-config\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.703782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.703733 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.703782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.703759 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1863550b-b2be-4a18-abab-77a15fdf2529-config-out\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.703986 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.703871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.704639 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.704614 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.704833 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.704814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-web-config\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.704883 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.704817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1863550b-b2be-4a18-abab-77a15fdf2529-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.705169 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.705153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.705252 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.705233 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.705327 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.705308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1863550b-b2be-4a18-abab-77a15fdf2529-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.707923 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.707903 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbwmj\" (UniqueName: \"kubernetes.io/projected/1863550b-b2be-4a18-abab-77a15fdf2529-kube-api-access-kbwmj\") pod \"prometheus-k8s-0\" (UID: \"1863550b-b2be-4a18-abab-77a15fdf2529\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.783750 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.783723 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:47.917688 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:47.917665 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:47.919543 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:48:47.919512 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1863550b_b2be_4a18_abab_77a15fdf2529.slice/crio-0752283a32bbb92ae9a8bcb22c3c01ea740e9b1a66cfb502ed0aa2232a75ce38 WatchSource:0}: Error finding container 0752283a32bbb92ae9a8bcb22c3c01ea740e9b1a66cfb502ed0aa2232a75ce38: Status 404 returned error can't find the container with id 0752283a32bbb92ae9a8bcb22c3c01ea740e9b1a66cfb502ed0aa2232a75ce38 Jun 03 20:48:48.419639 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:48.419566 2560 generic.go:356] "Generic (PLEG): container finished" podID="1863550b-b2be-4a18-abab-77a15fdf2529" containerID="a14f428a29edc2365fc75623abbba3eb65bc100630806200ffe10b29c010d680" exitCode=0 Jun 03 20:48:48.419786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:48.419642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerDied","Data":"a14f428a29edc2365fc75623abbba3eb65bc100630806200ffe10b29c010d680"} Jun 03 20:48:48.419786 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:48.419729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"0752283a32bbb92ae9a8bcb22c3c01ea740e9b1a66cfb502ed0aa2232a75ce38"} Jun 03 20:48:48.421491 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:48.421471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h4mvp" event={"ID":"5e7bf515-83c9-4908-bc40-091d45e0f00a","Type":"ContainerStarted","Data":"a4851e9a581d42f55ab22b1b073628a859ea8d878d70d5963276d4ff004de630"} Jun 03 20:48:49.216301 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.216251 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5d89e05-8d69-4670-9652-0168a8643a0e" path="/var/lib/kubelet/pods/b5d89e05-8d69-4670-9652-0168a8643a0e/volumes" Jun 03 20:48:49.427085 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.427046 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h4mvp" event={"ID":"5e7bf515-83c9-4908-bc40-091d45e0f00a","Type":"ContainerStarted","Data":"57e0b5950cfa87f0573fede4a88892d7ca8e4dbed36155de119b5431ea57105d"} Jun 03 20:48:49.427295 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.427108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h4mvp" event={"ID":"5e7bf515-83c9-4908-bc40-091d45e0f00a","Type":"ContainerStarted","Data":"b85c00f719840cdb37c6413b8847d7f677fd18346051ea6751ee6551ce2b8355"} Jun 03 20:48:49.429994 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.429968 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"feb7253d2d74b1000068e4aa8d41a601388d06886c7c7f7dba703b70b5b6ce12"} Jun 03 20:48:49.430090 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.430036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"fbc6af55fc7e288697df7d79f1553228e3cc55933ea01fa16b14d326a9711c11"} Jun 03 20:48:49.430090 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.430077 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"96fd0dacdef39697cf44aead901af8ab8612884990eaa8af7db2b2a6e7541719"} Jun 03 20:48:49.430163 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.430151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"0f3fb7ea03c151a2cf6b0f9e681d2aa4b065415c82d8788efb13d0e9782ba393"} Jun 03 20:48:49.430211 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.430197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"eaf9afc31b178d2e2770ec67c58ae2cbd734b98b26d2fd966bcec15b51da8dd1"} Jun 03 20:48:49.430288 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.430247 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1863550b-b2be-4a18-abab-77a15fdf2529","Type":"ContainerStarted","Data":"558a6695bc388aab4b80768fb2b8929a0f86b538c49758d3df61da2263a3c17b"} Jun 03 20:48:49.443016 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.442965 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h4mvp" podStartSLOduration=375.560922775 podStartE2EDuration="6m16.442951054s" totalImagesPullingTime="882.028279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:49.441858121 +0000 UTC m=+376.651171342" watchObservedRunningTime="2026-06-03 20:48:49.442951054 +0000 UTC m=+376.652264273" Jun 03 20:48:49.473330 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:49.473225 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.451779138 podStartE2EDuration="2.473209904s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.430766ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:49.467956384 +0000 UTC m=+376.677269610" watchObservedRunningTime="2026-06-03 20:48:49.473209904 +0000 UTC m=+376.682523124" Jun 03 20:48:52.784544 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:48:52.784494 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:49:47.784403 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:49:47.784365 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:49:47.799620 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:49:47.799587 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:49:48.667970 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:49:48.667945 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:51:18.244781 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.244745 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz"] Jun 03 20:51:18.247938 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.247921 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.250526 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.250506 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 20:51:18.250659 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.250548 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qf9ld\"" Jun 03 20:51:18.251301 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.251286 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 20:51:18.260327 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.260305 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz"] Jun 03 20:51:18.335957 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.335931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flc4k\" (UniqueName: \"kubernetes.io/projected/cb945cd6-c8c6-43ea-92f1-371c82be9f1c-kube-api-access-flc4k\") pod \"cert-manager-webhook-7dc76cbb94-zm4gz\" (UID: \"cb945cd6-c8c6-43ea-92f1-371c82be9f1c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.336173 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.335981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb945cd6-c8c6-43ea-92f1-371c82be9f1c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-zm4gz\" (UID: \"cb945cd6-c8c6-43ea-92f1-371c82be9f1c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.436932 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.436899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flc4k\" (UniqueName: \"kubernetes.io/projected/cb945cd6-c8c6-43ea-92f1-371c82be9f1c-kube-api-access-flc4k\") pod \"cert-manager-webhook-7dc76cbb94-zm4gz\" (UID: \"cb945cd6-c8c6-43ea-92f1-371c82be9f1c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.437091 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.436951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb945cd6-c8c6-43ea-92f1-371c82be9f1c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-zm4gz\" (UID: \"cb945cd6-c8c6-43ea-92f1-371c82be9f1c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.444710 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.444673 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb945cd6-c8c6-43ea-92f1-371c82be9f1c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-zm4gz\" (UID: \"cb945cd6-c8c6-43ea-92f1-371c82be9f1c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.444838 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.444763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flc4k\" (UniqueName: \"kubernetes.io/projected/cb945cd6-c8c6-43ea-92f1-371c82be9f1c-kube-api-access-flc4k\") pod \"cert-manager-webhook-7dc76cbb94-zm4gz\" (UID: \"cb945cd6-c8c6-43ea-92f1-371c82be9f1c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.565732 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.565662 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:18.701301 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.701254 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz"] Jun 03 20:51:18.704376 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:51:18.704334 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb945cd6_c8c6_43ea_92f1_371c82be9f1c.slice/crio-6e3f829516dd0e6e569baed85cc03a0545a2d49a9c6b61d226f2f05351240210 WatchSource:0}: Error finding container 6e3f829516dd0e6e569baed85cc03a0545a2d49a9c6b61d226f2f05351240210: Status 404 returned error can't find the container with id 6e3f829516dd0e6e569baed85cc03a0545a2d49a9c6b61d226f2f05351240210 Jun 03 20:51:18.983837 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:18.983806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" event={"ID":"cb945cd6-c8c6-43ea-92f1-371c82be9f1c","Type":"ContainerStarted","Data":"6e3f829516dd0e6e569baed85cc03a0545a2d49a9c6b61d226f2f05351240210"} Jun 03 20:51:23.003013 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:23.002975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" event={"ID":"cb945cd6-c8c6-43ea-92f1-371c82be9f1c","Type":"ContainerStarted","Data":"af1e4066f557f1d8687797927d40d9bc8d541f3eafd7bacdd851de6adffee687"} Jun 03 20:51:23.003485 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:23.003100 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:23.021721 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:23.021674 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" podStartSLOduration=1.494579712 podStartE2EDuration="5.021658617s" totalImagesPullingTime="3.527078905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:23.020611369 +0000 UTC m=+530.229924589" watchObservedRunningTime="2026-06-03 20:51:23.021658617 +0000 UTC m=+530.230971838" Jun 03 20:51:29.009680 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:29.009652 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-zm4gz" Jun 03 20:51:37.553164 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.553132 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2hhc8"] Jun 03 20:51:37.559570 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.559554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.561849 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.561833 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8r7pm\"" Jun 03 20:51:37.565402 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.565380 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2hhc8"] Jun 03 20:51:37.683457 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.683423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9be94cbe-5528-4f07-91a4-8b2414d98acd-bound-sa-token\") pod \"cert-manager-59c77684cc-2hhc8\" (UID: \"9be94cbe-5528-4f07-91a4-8b2414d98acd\") " pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.683619 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.683488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhdhb\" (UniqueName: \"kubernetes.io/projected/9be94cbe-5528-4f07-91a4-8b2414d98acd-kube-api-access-rhdhb\") pod \"cert-manager-59c77684cc-2hhc8\" (UID: \"9be94cbe-5528-4f07-91a4-8b2414d98acd\") " pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.784046 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.783987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9be94cbe-5528-4f07-91a4-8b2414d98acd-bound-sa-token\") pod \"cert-manager-59c77684cc-2hhc8\" (UID: \"9be94cbe-5528-4f07-91a4-8b2414d98acd\") " pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.784194 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.784106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhdhb\" (UniqueName: \"kubernetes.io/projected/9be94cbe-5528-4f07-91a4-8b2414d98acd-kube-api-access-rhdhb\") pod \"cert-manager-59c77684cc-2hhc8\" (UID: \"9be94cbe-5528-4f07-91a4-8b2414d98acd\") " pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.793573 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.793547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9be94cbe-5528-4f07-91a4-8b2414d98acd-bound-sa-token\") pod \"cert-manager-59c77684cc-2hhc8\" (UID: \"9be94cbe-5528-4f07-91a4-8b2414d98acd\") " pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.793704 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.793621 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhdhb\" (UniqueName: \"kubernetes.io/projected/9be94cbe-5528-4f07-91a4-8b2414d98acd-kube-api-access-rhdhb\") pod \"cert-manager-59c77684cc-2hhc8\" (UID: \"9be94cbe-5528-4f07-91a4-8b2414d98acd\") " pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.869389 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.869329 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2hhc8" Jun 03 20:51:37.992934 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:37.992788 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2hhc8"] Jun 03 20:51:37.995421 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:51:37.995395 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9be94cbe_5528_4f07_91a4_8b2414d98acd.slice/crio-fbbd1cbb56646c3d53420d50998bf1241dcdd2585dfa7e5e04ac97f97f17c0ad WatchSource:0}: Error finding container fbbd1cbb56646c3d53420d50998bf1241dcdd2585dfa7e5e04ac97f97f17c0ad: Status 404 returned error can't find the container with id fbbd1cbb56646c3d53420d50998bf1241dcdd2585dfa7e5e04ac97f97f17c0ad Jun 03 20:51:38.060788 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:38.060767 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2hhc8" event={"ID":"9be94cbe-5528-4f07-91a4-8b2414d98acd","Type":"ContainerStarted","Data":"f00803f79a1942b9b3bd9e8bd23c90f1c2d2771d97ba276801637c8dd321e7e8"} Jun 03 20:51:38.060788 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:38.060799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2hhc8" event={"ID":"9be94cbe-5528-4f07-91a4-8b2414d98acd","Type":"ContainerStarted","Data":"fbbd1cbb56646c3d53420d50998bf1241dcdd2585dfa7e5e04ac97f97f17c0ad"} Jun 03 20:51:38.074974 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:38.074932 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2hhc8" podStartSLOduration=1.074917978 podStartE2EDuration="1.074917978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:38.074060891 +0000 UTC m=+545.283374114" watchObservedRunningTime="2026-06-03 20:51:38.074917978 +0000 UTC m=+545.284231198" Jun 03 20:51:50.772454 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.772424 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt"] Jun 03 20:51:50.777844 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.777825 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.781286 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.781237 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vhlf2\"" Jun 03 20:51:50.781451 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.781424 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 20:51:50.781556 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.781510 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 20:51:50.781556 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.781512 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 20:51:50.781759 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.781746 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 20:51:50.792442 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.792423 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt"] Jun 03 20:51:50.889020 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.888955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03e7efc0-287f-45b2-9eb9-df2ea6a49009-tmp\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.889020 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.888993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7hc\" (UniqueName: \"kubernetes.io/projected/03e7efc0-287f-45b2-9eb9-df2ea6a49009-kube-api-access-bk7hc\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.889186 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.889028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03e7efc0-287f-45b2-9eb9-df2ea6a49009-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.889186 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.889103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03e7efc0-287f-45b2-9eb9-df2ea6a49009-manifests\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.889186 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.889136 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03e7efc0-287f-45b2-9eb9-df2ea6a49009-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.989811 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.989783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03e7efc0-287f-45b2-9eb9-df2ea6a49009-tmp\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.989992 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.989824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7hc\" (UniqueName: \"kubernetes.io/projected/03e7efc0-287f-45b2-9eb9-df2ea6a49009-kube-api-access-bk7hc\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.989992 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.989857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03e7efc0-287f-45b2-9eb9-df2ea6a49009-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.989992 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.989889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03e7efc0-287f-45b2-9eb9-df2ea6a49009-manifests\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.989992 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.989911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03e7efc0-287f-45b2-9eb9-df2ea6a49009-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.990316 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.990296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03e7efc0-287f-45b2-9eb9-df2ea6a49009-manifests\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.992247 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.992214 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03e7efc0-287f-45b2-9eb9-df2ea6a49009-tmp\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.992369 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.992280 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03e7efc0-287f-45b2-9eb9-df2ea6a49009-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.992369 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.992323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03e7efc0-287f-45b2-9eb9-df2ea6a49009-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:50.998532 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:50.998515 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7hc\" (UniqueName: \"kubernetes.io/projected/03e7efc0-287f-45b2-9eb9-df2ea6a49009-kube-api-access-bk7hc\") pod \"opendatahub-operator-controller-manager-6fdd65c64b-z7gxt\" (UID: \"03e7efc0-287f-45b2-9eb9-df2ea6a49009\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:51.088572 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:51.088543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:51.218994 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:51.218972 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt"] Jun 03 20:51:51.221955 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:51:51.221931 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e7efc0_287f_45b2_9eb9_df2ea6a49009.slice/crio-c5a2385a755b5bca362cc1d76e72140578f5913485e4eb07d1cc28bc33a93847 WatchSource:0}: Error finding container c5a2385a755b5bca362cc1d76e72140578f5913485e4eb07d1cc28bc33a93847: Status 404 returned error can't find the container with id c5a2385a755b5bca362cc1d76e72140578f5913485e4eb07d1cc28bc33a93847 Jun 03 20:51:52.119322 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:52.119227 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" event={"ID":"03e7efc0-287f-45b2-9eb9-df2ea6a49009","Type":"ContainerStarted","Data":"c5a2385a755b5bca362cc1d76e72140578f5913485e4eb07d1cc28bc33a93847"} Jun 03 20:51:54.130851 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:54.130816 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" event={"ID":"03e7efc0-287f-45b2-9eb9-df2ea6a49009","Type":"ContainerStarted","Data":"c414150d160f94f7b49124faa71518a4c6369cc717839b9d94ccfcc96c9bded0"} Jun 03 20:51:55.136583 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:55.136548 2560 generic.go:356] "Generic (PLEG): container finished" podID="03e7efc0-287f-45b2-9eb9-df2ea6a49009" containerID="c414150d160f94f7b49124faa71518a4c6369cc717839b9d94ccfcc96c9bded0" exitCode=0 Jun 03 20:51:55.136933 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:55.136615 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" event={"ID":"03e7efc0-287f-45b2-9eb9-df2ea6a49009","Type":"ContainerDied","Data":"c414150d160f94f7b49124faa71518a4c6369cc717839b9d94ccfcc96c9bded0"} Jun 03 20:51:56.142851 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:56.142814 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" event={"ID":"03e7efc0-287f-45b2-9eb9-df2ea6a49009","Type":"ContainerStarted","Data":"5e6ab462d06fd9e927a459e3fab9d15aeb5ac8314db85572e807e6d18cc8e57d"} Jun 03 20:51:56.143313 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:56.142960 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:51:56.168212 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:51:56.168159 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" podStartSLOduration=2.157079817 podStartE2EDuration="6.16814162s" totalImagesPullingTime="3.083041082s" totalInitContainerRuntime="928.020721ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:56.166123128 +0000 UTC m=+563.375436371" watchObservedRunningTime="2026-06-03 20:51:56.16814162 +0000 UTC m=+563.377454840" Jun 03 20:52:07.149789 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:07.149762 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd65c64b-z7gxt" Jun 03 20:52:08.672776 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.672745 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw"] Jun 03 20:52:08.680664 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.680641 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.703225 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.703200 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 20:52:08.704188 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.704147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 20:52:08.704346 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.704269 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:52:08.704419 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.704402 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 20:52:08.704502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.704479 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hw54z\"" Jun 03 20:52:08.704502 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.704486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 20:52:08.706130 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.706105 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw"] Jun 03 20:52:08.730726 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.730705 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d2a6335-1251-4845-aeb5-735362b38f54-manager-config\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.730827 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.730756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d2a6335-1251-4845-aeb5-735362b38f54-metrics-cert\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.730827 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.730776 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d2a6335-1251-4845-aeb5-735362b38f54-cert\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.730827 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.730823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nv2r\" (UniqueName: \"kubernetes.io/projected/9d2a6335-1251-4845-aeb5-735362b38f54-kube-api-access-9nv2r\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.831447 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.831419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d2a6335-1251-4845-aeb5-735362b38f54-metrics-cert\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.831447 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.831447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d2a6335-1251-4845-aeb5-735362b38f54-cert\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.831633 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.831469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nv2r\" (UniqueName: \"kubernetes.io/projected/9d2a6335-1251-4845-aeb5-735362b38f54-kube-api-access-9nv2r\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.831633 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.831512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d2a6335-1251-4845-aeb5-735362b38f54-manager-config\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.832177 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.832160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d2a6335-1251-4845-aeb5-735362b38f54-manager-config\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.834045 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.834023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d2a6335-1251-4845-aeb5-735362b38f54-metrics-cert\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.834136 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.834023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d2a6335-1251-4845-aeb5-735362b38f54-cert\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.859940 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.859913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nv2r\" (UniqueName: \"kubernetes.io/projected/9d2a6335-1251-4845-aeb5-735362b38f54-kube-api-access-9nv2r\") pod \"lws-controller-manager-b58f58db9-jgwzw\" (UID: \"9d2a6335-1251-4845-aeb5-735362b38f54\") " pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:08.989089 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:08.989023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:09.153631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.153606 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw"] Jun 03 20:52:09.155851 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:52:09.155826 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2a6335_1251_4845_aeb5_735362b38f54.slice/crio-4bdb3b6d712136ebce9148b4251d79c97056d24bca1277043fe9875a4cae2522 WatchSource:0}: Error finding container 4bdb3b6d712136ebce9148b4251d79c97056d24bca1277043fe9875a4cae2522: Status 404 returned error can't find the container with id 4bdb3b6d712136ebce9148b4251d79c97056d24bca1277043fe9875a4cae2522 Jun 03 20:52:09.200482 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.200451 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" event={"ID":"9d2a6335-1251-4845-aeb5-735362b38f54","Type":"ContainerStarted","Data":"4bdb3b6d712136ebce9148b4251d79c97056d24bca1277043fe9875a4cae2522"} Jun 03 20:52:09.381655 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.381576 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb"] Jun 03 20:52:09.385983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.385961 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.390167 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.390148 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 20:52:09.390304 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.390282 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 20:52:09.390374 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.390339 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 20:52:09.391021 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.391007 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7gqf\"" Jun 03 20:52:09.391973 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.391957 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 20:52:09.405751 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.405726 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb"] Jun 03 20:52:09.435969 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.435943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf5p\" (UniqueName: \"kubernetes.io/projected/9738cf3e-4a64-4c5c-a275-93b453cc7560-kube-api-access-hlf5p\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.436081 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.436016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9738cf3e-4a64-4c5c-a275-93b453cc7560-tmp\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.436081 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.436076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9738cf3e-4a64-4c5c-a275-93b453cc7560-tls-certs\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.536550 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.536518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf5p\" (UniqueName: \"kubernetes.io/projected/9738cf3e-4a64-4c5c-a275-93b453cc7560-kube-api-access-hlf5p\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.536677 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.536587 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9738cf3e-4a64-4c5c-a275-93b453cc7560-tmp\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.536677 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.536633 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9738cf3e-4a64-4c5c-a275-93b453cc7560-tls-certs\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.538737 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.538716 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9738cf3e-4a64-4c5c-a275-93b453cc7560-tmp\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.538971 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.538952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9738cf3e-4a64-4c5c-a275-93b453cc7560-tls-certs\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.560700 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.560681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf5p\" (UniqueName: \"kubernetes.io/projected/9738cf3e-4a64-4c5c-a275-93b453cc7560-kube-api-access-hlf5p\") pod \"kube-auth-proxy-79b6b976dd-9mbfb\" (UID: \"9738cf3e-4a64-4c5c-a275-93b453cc7560\") " pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.696183 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.696155 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" Jun 03 20:52:09.859299 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:09.859270 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb"] Jun 03 20:52:09.862082 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:52:09.862044 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9738cf3e_4a64_4c5c_a275_93b453cc7560.slice/crio-a69838abd19d2bbba6f96d1c08c68e14eccc0a4f3dd68fe2d6229572f9986c57 WatchSource:0}: Error finding container a69838abd19d2bbba6f96d1c08c68e14eccc0a4f3dd68fe2d6229572f9986c57: Status 404 returned error can't find the container with id a69838abd19d2bbba6f96d1c08c68e14eccc0a4f3dd68fe2d6229572f9986c57 Jun 03 20:52:10.209410 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:10.209370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" event={"ID":"9738cf3e-4a64-4c5c-a275-93b453cc7560","Type":"ContainerStarted","Data":"a69838abd19d2bbba6f96d1c08c68e14eccc0a4f3dd68fe2d6229572f9986c57"} Jun 03 20:52:13.227385 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:13.227296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" event={"ID":"9d2a6335-1251-4845-aeb5-735362b38f54","Type":"ContainerStarted","Data":"1c64bc64d083d2e6011f71a34e085598d6e5880a9aca6475428a7fe4c0917de0"} Jun 03 20:52:13.227385 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:13.227358 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:13.228698 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:13.228674 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" event={"ID":"9738cf3e-4a64-4c5c-a275-93b453cc7560","Type":"ContainerStarted","Data":"fdb801d259d53e0961252e2189bbc94e8651073f88563ea02457ce69aeb8291c"} Jun 03 20:52:13.265191 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:13.265145 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" podStartSLOduration=1.4700099739999999 podStartE2EDuration="5.265131456s" totalImagesPullingTime="3.795121482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:13.264066701 +0000 UTC m=+580.473379921" watchObservedRunningTime="2026-06-03 20:52:13.265131456 +0000 UTC m=+580.474444675" Jun 03 20:52:13.301139 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:13.301089 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79b6b976dd-9mbfb" podStartSLOduration=1.169453877 podStartE2EDuration="4.301075596s" totalImagesPullingTime="3.131621719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:13.30077766 +0000 UTC m=+580.510090891" watchObservedRunningTime="2026-06-03 20:52:13.301075596 +0000 UTC m=+580.510388815" Jun 03 20:52:24.235670 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:24.235639 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b58f58db9-jgwzw" Jun 03 20:52:33.221695 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:33.221599 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:52:33.231134 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:52:33.221816 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:53:47.101673 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.101638 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws"] Jun 03 20:53:47.104731 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.104716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:53:47.113983 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.113963 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 20:53:47.114872 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.114856 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nbc52\"" Jun 03 20:53:47.114938 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.114904 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:53:47.114975 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.114959 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:53:47.145725 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.145695 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws"] Jun 03 20:53:47.155198 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.155176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxv6\" (UniqueName: \"kubernetes.io/projected/b571c348-17c0-4489-8d87-e4170000e355-kube-api-access-fnxv6\") pod \"dns-operator-controller-manager-864dd78c4c-9v5ws\" (UID: \"b571c348-17c0-4489-8d87-e4170000e355\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:53:47.255833 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.255804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxv6\" (UniqueName: \"kubernetes.io/projected/b571c348-17c0-4489-8d87-e4170000e355-kube-api-access-fnxv6\") pod \"dns-operator-controller-manager-864dd78c4c-9v5ws\" (UID: \"b571c348-17c0-4489-8d87-e4170000e355\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:53:47.287282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.287232 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxv6\" (UniqueName: \"kubernetes.io/projected/b571c348-17c0-4489-8d87-e4170000e355-kube-api-access-fnxv6\") pod \"dns-operator-controller-manager-864dd78c4c-9v5ws\" (UID: \"b571c348-17c0-4489-8d87-e4170000e355\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:53:47.415142 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.415066 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:53:47.586879 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.586843 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws"] Jun 03 20:53:47.587240 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:53:47.587216 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb571c348_17c0_4489_8d87_e4170000e355.slice/crio-3305f708db76b4a1aa54d590bc6fc8ffe1a7cafcc8ca568ecb00fdf9a84eea2b WatchSource:0}: Error finding container 3305f708db76b4a1aa54d590bc6fc8ffe1a7cafcc8ca568ecb00fdf9a84eea2b: Status 404 returned error can't find the container with id 3305f708db76b4a1aa54d590bc6fc8ffe1a7cafcc8ca568ecb00fdf9a84eea2b Jun 03 20:53:47.589782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.589765 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:53:47.620140 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:47.620106 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" event={"ID":"b571c348-17c0-4489-8d87-e4170000e355","Type":"ContainerStarted","Data":"3305f708db76b4a1aa54d590bc6fc8ffe1a7cafcc8ca568ecb00fdf9a84eea2b"} Jun 03 20:53:49.631778 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:49.631692 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" event={"ID":"b571c348-17c0-4489-8d87-e4170000e355","Type":"ContainerStarted","Data":"d3d37434d27c13eb809104965be6e75f89c9e2d62b2cdb82b76ac9d4354cffea"} Jun 03 20:53:49.631778 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:49.631758 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:53:49.663546 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:53:49.663502 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" podStartSLOduration=0.872606346 podStartE2EDuration="2.663485436s" totalImagesPullingTime="1.79087909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:49.662388505 +0000 UTC m=+676.871701737" watchObservedRunningTime="2026-06-03 20:53:49.663485436 +0000 UTC m=+676.872798663" Jun 03 20:54:00.638532 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:00.638497 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9v5ws" Jun 03 20:54:41.957105 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:41.957074 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:41.960273 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:41.960241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:41.969455 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:41.969423 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qkqzb\"" Jun 03 20:54:41.969762 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:41.969732 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 20:54:41.994801 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:41.994774 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:42.010311 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.010290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-config-file\") pod \"limitador-limitador-64c94fd64f-6dj4g\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.010476 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.010457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjpr\" (UniqueName: \"kubernetes.io/projected/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-kube-api-access-kxjpr\") pod \"limitador-limitador-64c94fd64f-6dj4g\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.098953 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.098923 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:42.111586 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.111560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjpr\" (UniqueName: \"kubernetes.io/projected/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-kube-api-access-kxjpr\") pod \"limitador-limitador-64c94fd64f-6dj4g\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.111706 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.111592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-config-file\") pod \"limitador-limitador-64c94fd64f-6dj4g\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.112197 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.112178 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-config-file\") pod \"limitador-limitador-64c94fd64f-6dj4g\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.127547 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.127523 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjpr\" (UniqueName: \"kubernetes.io/projected/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-kube-api-access-kxjpr\") pod \"limitador-limitador-64c94fd64f-6dj4g\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.270419 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.270343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:42.416748 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.416720 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:42.420156 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:54:42.420129 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfba5b4_3e68_4a0b_9dc2_6975685ad150.slice/crio-33c3a0231976bed82fca096f970ddd56997f09629e5b7116de1b118dacb1f154 WatchSource:0}: Error finding container 33c3a0231976bed82fca096f970ddd56997f09629e5b7116de1b118dacb1f154: Status 404 returned error can't find the container with id 33c3a0231976bed82fca096f970ddd56997f09629e5b7116de1b118dacb1f154 Jun 03 20:54:42.875318 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:42.875169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" event={"ID":"8bfba5b4-3e68-4a0b-9dc2-6975685ad150","Type":"ContainerStarted","Data":"33c3a0231976bed82fca096f970ddd56997f09629e5b7116de1b118dacb1f154"} Jun 03 20:54:43.737946 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.737914 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-p2bc8"] Jun 03 20:54:43.745949 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.745929 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:54:43.752630 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.752607 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zmhlz\"" Jun 03 20:54:43.761415 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.761393 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p2bc8"] Jun 03 20:54:43.828824 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.828798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zb2\" (UniqueName: \"kubernetes.io/projected/673cbcc6-638d-4968-9bc0-529180957f03-kube-api-access-49zb2\") pod \"authorino-75d556bd77-p2bc8\" (UID: \"673cbcc6-638d-4968-9bc0-529180957f03\") " pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:54:43.930315 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.930284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49zb2\" (UniqueName: \"kubernetes.io/projected/673cbcc6-638d-4968-9bc0-529180957f03-kube-api-access-49zb2\") pod \"authorino-75d556bd77-p2bc8\" (UID: \"673cbcc6-638d-4968-9bc0-529180957f03\") " pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:54:43.942762 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:43.942734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zb2\" (UniqueName: \"kubernetes.io/projected/673cbcc6-638d-4968-9bc0-529180957f03-kube-api-access-49zb2\") pod \"authorino-75d556bd77-p2bc8\" (UID: \"673cbcc6-638d-4968-9bc0-529180957f03\") " pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:54:44.057808 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:44.057739 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:54:44.921369 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:44.921344 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p2bc8"] Jun 03 20:54:44.922843 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:54:44.922819 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod673cbcc6_638d_4968_9bc0_529180957f03.slice/crio-a8e1b3f30ba1d936b01cf0f3310349e5af2510da5afa06cf300e0ae3309b66af WatchSource:0}: Error finding container a8e1b3f30ba1d936b01cf0f3310349e5af2510da5afa06cf300e0ae3309b66af: Status 404 returned error can't find the container with id a8e1b3f30ba1d936b01cf0f3310349e5af2510da5afa06cf300e0ae3309b66af Jun 03 20:54:45.892867 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:45.892604 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" event={"ID":"8bfba5b4-3e68-4a0b-9dc2-6975685ad150","Type":"ContainerStarted","Data":"1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7"} Jun 03 20:54:45.892867 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:45.892713 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:45.894320 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:45.894291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p2bc8" event={"ID":"673cbcc6-638d-4968-9bc0-529180957f03","Type":"ContainerStarted","Data":"a8e1b3f30ba1d936b01cf0f3310349e5af2510da5afa06cf300e0ae3309b66af"} Jun 03 20:54:47.905615 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:47.905576 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p2bc8" event={"ID":"673cbcc6-638d-4968-9bc0-529180957f03","Type":"ContainerStarted","Data":"721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0"} Jun 03 20:54:47.959166 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:47.959124 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" podStartSLOduration=4.554912994 podStartE2EDuration="6.959109431s" totalImagesPullingTime="2.404196437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:45.932131719 +0000 UTC m=+733.141444939" watchObservedRunningTime="2026-06-03 20:54:47.959109431 +0000 UTC m=+735.168422651" Jun 03 20:54:47.959565 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:47.959537 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-p2bc8" podStartSLOduration=2.15515245 podStartE2EDuration="4.959528582s" totalImagesPullingTime="2.804376132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:47.959082903 +0000 UTC m=+735.168396123" watchObservedRunningTime="2026-06-03 20:54:47.959528582 +0000 UTC m=+735.168841803" Jun 03 20:54:56.899821 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:56.899792 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:57.182792 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.182763 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:57.182982 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.182956 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" podUID="8bfba5b4-3e68-4a0b-9dc2-6975685ad150" containerName="limitador" containerID="cri-o://1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7" gracePeriod=30 Jun 03 20:54:57.730238 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.730212 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:57.851111 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.851040 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxjpr\" (UniqueName: \"kubernetes.io/projected/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-kube-api-access-kxjpr\") pod \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " Jun 03 20:54:57.851246 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.851133 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-config-file\") pod \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\" (UID: \"8bfba5b4-3e68-4a0b-9dc2-6975685ad150\") " Jun 03 20:54:57.851504 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.851481 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-config-file" (OuterVolumeSpecName: "config-file") pod "8bfba5b4-3e68-4a0b-9dc2-6975685ad150" (UID: "8bfba5b4-3e68-4a0b-9dc2-6975685ad150"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:54:57.853115 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.853090 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-kube-api-access-kxjpr" (OuterVolumeSpecName: "kube-api-access-kxjpr") pod "8bfba5b4-3e68-4a0b-9dc2-6975685ad150" (UID: "8bfba5b4-3e68-4a0b-9dc2-6975685ad150"). InnerVolumeSpecName "kube-api-access-kxjpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:57.950361 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.950330 2560 generic.go:356] "Generic (PLEG): container finished" podID="8bfba5b4-3e68-4a0b-9dc2-6975685ad150" containerID="1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7" exitCode=0 Jun 03 20:54:57.950772 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.950369 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" Jun 03 20:54:57.950772 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.950416 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" event={"ID":"8bfba5b4-3e68-4a0b-9dc2-6975685ad150","Type":"ContainerDied","Data":"1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7"} Jun 03 20:54:57.950772 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.950514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6dj4g" event={"ID":"8bfba5b4-3e68-4a0b-9dc2-6975685ad150","Type":"ContainerDied","Data":"33c3a0231976bed82fca096f970ddd56997f09629e5b7116de1b118dacb1f154"} Jun 03 20:54:57.950772 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.950547 2560 scope.go:117] "RemoveContainer" containerID="1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7" Jun 03 20:54:57.951684 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.951670 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-config-file\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:54:57.951736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.951688 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxjpr\" (UniqueName: \"kubernetes.io/projected/8bfba5b4-3e68-4a0b-9dc2-6975685ad150-kube-api-access-kxjpr\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:54:57.959631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.959616 2560 scope.go:117] "RemoveContainer" containerID="1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7" Jun 03 20:54:57.959879 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:54:57.959862 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7\": container with ID starting with 1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7 not found: ID does not exist" containerID="1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7" Jun 03 20:54:57.959944 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.959889 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7"} err="failed to get container status \"1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7\": rpc error: code = NotFound desc = could not find container \"1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7\": container with ID starting with 1edb9d59c5759ee39a35eddac15a6a0d83ced2806057e16911a4ed72fa88f3a7 not found: ID does not exist" Jun 03 20:54:57.985928 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:57.985903 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:58.004126 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:58.004104 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6dj4g"] Jun 03 20:54:59.215419 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:54:59.215385 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bfba5b4-3e68-4a0b-9dc2-6975685ad150" path="/var/lib/kubelet/pods/8bfba5b4-3e68-4a0b-9dc2-6975685ad150/volumes" Jun 03 20:55:02.192506 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.192468 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-dmcqn"] Jun 03 20:55:02.192965 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.192786 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bfba5b4-3e68-4a0b-9dc2-6975685ad150" containerName="limitador" Jun 03 20:55:02.192965 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.192796 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bfba5b4-3e68-4a0b-9dc2-6975685ad150" containerName="limitador" Jun 03 20:55:02.192965 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.192846 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bfba5b4-3e68-4a0b-9dc2-6975685ad150" containerName="limitador" Jun 03 20:55:02.197177 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.197158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.200861 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.200839 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jqgjn\"" Jun 03 20:55:02.201282 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.201242 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 20:55:02.209356 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.209337 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dmcqn"] Jun 03 20:55:02.290028 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.289992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/030b4166-450b-424b-94e4-f6c6f00d49cf-data\") pod \"postgres-69fb4594cf-dmcqn\" (UID: \"030b4166-450b-424b-94e4-f6c6f00d49cf\") " pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.290208 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.290052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58jjk\" (UniqueName: \"kubernetes.io/projected/030b4166-450b-424b-94e4-f6c6f00d49cf-kube-api-access-58jjk\") pod \"postgres-69fb4594cf-dmcqn\" (UID: \"030b4166-450b-424b-94e4-f6c6f00d49cf\") " pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.390686 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.390654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/030b4166-450b-424b-94e4-f6c6f00d49cf-data\") pod \"postgres-69fb4594cf-dmcqn\" (UID: \"030b4166-450b-424b-94e4-f6c6f00d49cf\") " pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.390850 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.390700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58jjk\" (UniqueName: \"kubernetes.io/projected/030b4166-450b-424b-94e4-f6c6f00d49cf-kube-api-access-58jjk\") pod \"postgres-69fb4594cf-dmcqn\" (UID: \"030b4166-450b-424b-94e4-f6c6f00d49cf\") " pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.391104 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.391084 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/030b4166-450b-424b-94e4-f6c6f00d49cf-data\") pod \"postgres-69fb4594cf-dmcqn\" (UID: \"030b4166-450b-424b-94e4-f6c6f00d49cf\") " pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.400852 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.400822 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58jjk\" (UniqueName: \"kubernetes.io/projected/030b4166-450b-424b-94e4-f6c6f00d49cf-kube-api-access-58jjk\") pod \"postgres-69fb4594cf-dmcqn\" (UID: \"030b4166-450b-424b-94e4-f6c6f00d49cf\") " pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.507015 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.506923 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:02.637405 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.637375 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dmcqn"] Jun 03 20:55:02.640055 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:55:02.640022 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030b4166_450b_424b_94e4_f6c6f00d49cf.slice/crio-0896a213aa76a5460e14a62d1190d56f17fb94757bdaea55d4757f55e2fa33b5 WatchSource:0}: Error finding container 0896a213aa76a5460e14a62d1190d56f17fb94757bdaea55d4757f55e2fa33b5: Status 404 returned error can't find the container with id 0896a213aa76a5460e14a62d1190d56f17fb94757bdaea55d4757f55e2fa33b5 Jun 03 20:55:02.975475 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:02.975437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dmcqn" event={"ID":"030b4166-450b-424b-94e4-f6c6f00d49cf","Type":"ContainerStarted","Data":"0896a213aa76a5460e14a62d1190d56f17fb94757bdaea55d4757f55e2fa33b5"} Jun 03 20:55:08.003168 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:08.003134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dmcqn" event={"ID":"030b4166-450b-424b-94e4-f6c6f00d49cf","Type":"ContainerStarted","Data":"4f887a4fef0dd90a5834a97f21519b6d5fa02c79db6f97fc9817a228e23a4745"} Jun 03 20:55:08.003567 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:08.003281 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:08.035683 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:08.035644 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-dmcqn" podStartSLOduration=1.258528277 podStartE2EDuration="6.035629857s" totalImagesPullingTime="4.77710158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:55:08.035036875 +0000 UTC m=+755.244350096" watchObservedRunningTime="2026-06-03 20:55:08.035629857 +0000 UTC m=+755.244943078" Jun 03 20:55:14.036229 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:14.036199 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-dmcqn" Jun 03 20:55:23.810078 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:23.810044 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-rpmdx"] Jun 03 20:55:24.078998 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.078930 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-rpmdx"] Jun 03 20:55:24.079134 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.079025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" Jun 03 20:55:24.082941 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.082923 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 20:55:24.083736 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.083721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 20:55:24.083791 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.083724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-f4c5s\"" Jun 03 20:55:24.085027 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.085004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbhp\" (UniqueName: \"kubernetes.io/projected/5461915d-b5ae-46be-9fda-b9fe3d7deb83-kube-api-access-mbbhp\") pod \"keycloak-operator-dd84cbf46-rpmdx\" (UID: \"5461915d-b5ae-46be-9fda-b9fe3d7deb83\") " pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" Jun 03 20:55:24.186333 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.186305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbhp\" (UniqueName: \"kubernetes.io/projected/5461915d-b5ae-46be-9fda-b9fe3d7deb83-kube-api-access-mbbhp\") pod \"keycloak-operator-dd84cbf46-rpmdx\" (UID: \"5461915d-b5ae-46be-9fda-b9fe3d7deb83\") " pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" Jun 03 20:55:24.195174 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.195146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbhp\" (UniqueName: \"kubernetes.io/projected/5461915d-b5ae-46be-9fda-b9fe3d7deb83-kube-api-access-mbbhp\") pod \"keycloak-operator-dd84cbf46-rpmdx\" (UID: \"5461915d-b5ae-46be-9fda-b9fe3d7deb83\") " pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" Jun 03 20:55:24.389209 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.389138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" Jun 03 20:55:24.532323 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:24.532197 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-rpmdx"] Jun 03 20:55:24.534905 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:55:24.534881 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5461915d_b5ae_46be_9fda_b9fe3d7deb83.slice/crio-97bb4e2e7b3a6324ee4a8cd9f3c3a43c2b9f9f436a0f23de340dced9bc9d7851 WatchSource:0}: Error finding container 97bb4e2e7b3a6324ee4a8cd9f3c3a43c2b9f9f436a0f23de340dced9bc9d7851: Status 404 returned error can't find the container with id 97bb4e2e7b3a6324ee4a8cd9f3c3a43c2b9f9f436a0f23de340dced9bc9d7851 Jun 03 20:55:25.082566 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:25.082501 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" event={"ID":"5461915d-b5ae-46be-9fda-b9fe3d7deb83","Type":"ContainerStarted","Data":"97bb4e2e7b3a6324ee4a8cd9f3c3a43c2b9f9f436a0f23de340dced9bc9d7851"} Jun 03 20:55:30.108271 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:30.108220 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" event={"ID":"5461915d-b5ae-46be-9fda-b9fe3d7deb83","Type":"ContainerStarted","Data":"4fa2e4b6764bb5da9281cc27b275f3f746cb4ed803814c6d8af443967b8de28c"} Jun 03 20:55:30.178040 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:55:30.177990 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-rpmdx" podStartSLOduration=1.7365223109999999 podStartE2EDuration="7.177975819s" totalImagesPullingTime="5.441453508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:55:30.177895261 +0000 UTC m=+777.387208482" watchObservedRunningTime="2026-06-03 20:55:30.177975819 +0000 UTC m=+777.387289039" Jun 03 20:56:08.965943 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:08.965866 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54985dbbf9-fznp2"] Jun 03 20:56:08.971979 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:08.971959 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:08.981299 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:08.981274 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54985dbbf9-fznp2"] Jun 03 20:56:09.081199 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.081168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4l7\" (UniqueName: \"kubernetes.io/projected/75668721-89c7-4a71-943c-e705a1fcdf74-kube-api-access-pw4l7\") pod \"authorino-54985dbbf9-fznp2\" (UID: \"75668721-89c7-4a71-943c-e705a1fcdf74\") " pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:09.181075 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.181044 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54985dbbf9-fznp2"] Jun 03 20:56:09.181376 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:56:09.181350 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pw4l7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-54985dbbf9-fznp2" podUID="75668721-89c7-4a71-943c-e705a1fcdf74" Jun 03 20:56:09.181615 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.181598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4l7\" (UniqueName: \"kubernetes.io/projected/75668721-89c7-4a71-943c-e705a1fcdf74-kube-api-access-pw4l7\") pod \"authorino-54985dbbf9-fznp2\" (UID: \"75668721-89c7-4a71-943c-e705a1fcdf74\") " pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:09.195880 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.195853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4l7\" (UniqueName: \"kubernetes.io/projected/75668721-89c7-4a71-943c-e705a1fcdf74-kube-api-access-pw4l7\") pod \"authorino-54985dbbf9-fznp2\" (UID: \"75668721-89c7-4a71-943c-e705a1fcdf74\") " pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:09.276745 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.276677 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:09.282518 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.282502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:09.383612 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.383587 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw4l7\" (UniqueName: \"kubernetes.io/projected/75668721-89c7-4a71-943c-e705a1fcdf74-kube-api-access-pw4l7\") pod \"75668721-89c7-4a71-943c-e705a1fcdf74\" (UID: \"75668721-89c7-4a71-943c-e705a1fcdf74\") " Jun 03 20:56:09.385593 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.385565 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75668721-89c7-4a71-943c-e705a1fcdf74-kube-api-access-pw4l7" (OuterVolumeSpecName: "kube-api-access-pw4l7") pod "75668721-89c7-4a71-943c-e705a1fcdf74" (UID: "75668721-89c7-4a71-943c-e705a1fcdf74"). InnerVolumeSpecName "kube-api-access-pw4l7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:09.484625 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:09.484599 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw4l7\" (UniqueName: \"kubernetes.io/projected/75668721-89c7-4a71-943c-e705a1fcdf74-kube-api-access-pw4l7\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:56:10.280801 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.280773 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54985dbbf9-fznp2" Jun 03 20:56:10.312244 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.312219 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54985dbbf9-fznp2"] Jun 03 20:56:10.319146 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.319125 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54985dbbf9-fznp2"] Jun 03 20:56:10.456488 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.456457 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p2bc8"] Jun 03 20:56:10.456631 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.456617 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-p2bc8" podUID="673cbcc6-638d-4968-9bc0-529180957f03" containerName="authorino" containerID="cri-o://721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0" gracePeriod=30 Jun 03 20:56:10.705662 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.705636 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:56:10.793782 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.793753 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49zb2\" (UniqueName: \"kubernetes.io/projected/673cbcc6-638d-4968-9bc0-529180957f03-kube-api-access-49zb2\") pod \"673cbcc6-638d-4968-9bc0-529180957f03\" (UID: \"673cbcc6-638d-4968-9bc0-529180957f03\") " Jun 03 20:56:10.795697 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.795672 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/673cbcc6-638d-4968-9bc0-529180957f03-kube-api-access-49zb2" (OuterVolumeSpecName: "kube-api-access-49zb2") pod "673cbcc6-638d-4968-9bc0-529180957f03" (UID: "673cbcc6-638d-4968-9bc0-529180957f03"). InnerVolumeSpecName "kube-api-access-49zb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:56:10.894992 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:10.894917 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49zb2\" (UniqueName: \"kubernetes.io/projected/673cbcc6-638d-4968-9bc0-529180957f03-kube-api-access-49zb2\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 20:56:11.216356 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.216317 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75668721-89c7-4a71-943c-e705a1fcdf74" path="/var/lib/kubelet/pods/75668721-89c7-4a71-943c-e705a1fcdf74/volumes" Jun 03 20:56:11.286423 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.286392 2560 generic.go:356] "Generic (PLEG): container finished" podID="673cbcc6-638d-4968-9bc0-529180957f03" containerID="721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0" exitCode=0 Jun 03 20:56:11.286818 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.286429 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p2bc8" Jun 03 20:56:11.286818 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.286442 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p2bc8" event={"ID":"673cbcc6-638d-4968-9bc0-529180957f03","Type":"ContainerDied","Data":"721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0"} Jun 03 20:56:11.286818 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.286471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p2bc8" event={"ID":"673cbcc6-638d-4968-9bc0-529180957f03","Type":"ContainerDied","Data":"a8e1b3f30ba1d936b01cf0f3310349e5af2510da5afa06cf300e0ae3309b66af"} Jun 03 20:56:11.286818 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.286486 2560 scope.go:117] "RemoveContainer" containerID="721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0" Jun 03 20:56:11.295157 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.295137 2560 scope.go:117] "RemoveContainer" containerID="721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0" Jun 03 20:56:11.295471 ip-10-0-130-87 kubenswrapper[2560]: E0603 20:56:11.295451 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0\": container with ID starting with 721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0 not found: ID does not exist" containerID="721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0" Jun 03 20:56:11.295538 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.295479 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0"} err="failed to get container status \"721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0\": rpc error: code = NotFound desc = could not find container \"721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0\": container with ID starting with 721daec118a1f48a0941c018ae4731fee367ec4c1c26998b7750fa113feb4db0 not found: ID does not exist" Jun 03 20:56:11.302892 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.302870 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p2bc8"] Jun 03 20:56:11.307416 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:11.307396 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p2bc8"] Jun 03 20:56:13.215834 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:56:13.215805 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="673cbcc6-638d-4968-9bc0-529180957f03" path="/var/lib/kubelet/pods/673cbcc6-638d-4968-9bc0-529180957f03/volumes" Jun 03 20:57:33.248361 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:33.248229 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:57:33.250456 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:33.249601 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 20:57:37.973949 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.973914 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-869c65cbff-4x24w"] Jun 03 20:57:37.974444 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.974425 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="673cbcc6-638d-4968-9bc0-529180957f03" containerName="authorino" Jun 03 20:57:37.974518 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.974447 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="673cbcc6-638d-4968-9bc0-529180957f03" containerName="authorino" Jun 03 20:57:37.974577 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.974559 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="673cbcc6-638d-4968-9bc0-529180957f03" containerName="authorino" Jun 03 20:57:37.976221 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.976200 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:37.979243 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.979222 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zmhlz\"" Jun 03 20:57:37.979243 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.979230 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 20:57:37.979420 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.979276 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 20:57:37.984381 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:37.984363 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869c65cbff-4x24w"] Jun 03 20:57:38.140232 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.140200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/788a2cf7-5eae-450e-979a-56970d87d728-oidc-ca\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.140409 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.140316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t474g\" (UniqueName: \"kubernetes.io/projected/788a2cf7-5eae-450e-979a-56970d87d728-kube-api-access-t474g\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.140409 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.140342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/788a2cf7-5eae-450e-979a-56970d87d728-tls-cert\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.241096 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.241026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t474g\" (UniqueName: \"kubernetes.io/projected/788a2cf7-5eae-450e-979a-56970d87d728-kube-api-access-t474g\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.241096 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.241062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/788a2cf7-5eae-450e-979a-56970d87d728-tls-cert\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.241096 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.241087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/788a2cf7-5eae-450e-979a-56970d87d728-oidc-ca\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.241702 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.241683 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/788a2cf7-5eae-450e-979a-56970d87d728-oidc-ca\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.243552 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.243529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/788a2cf7-5eae-450e-979a-56970d87d728-tls-cert\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.249700 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.249682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t474g\" (UniqueName: \"kubernetes.io/projected/788a2cf7-5eae-450e-979a-56970d87d728-kube-api-access-t474g\") pod \"authorino-869c65cbff-4x24w\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.285635 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.285615 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 20:57:38.411575 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.411549 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869c65cbff-4x24w"] Jun 03 20:57:38.413580 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:57:38.413549 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod788a2cf7_5eae_450e_979a_56970d87d728.slice/crio-bba1be5efcea9d8b82a2ba08aa995db4abd2de7af10d7b4cf764266bbb9cfe49 WatchSource:0}: Error finding container bba1be5efcea9d8b82a2ba08aa995db4abd2de7af10d7b4cf764266bbb9cfe49: Status 404 returned error can't find the container with id bba1be5efcea9d8b82a2ba08aa995db4abd2de7af10d7b4cf764266bbb9cfe49 Jun 03 20:57:38.682297 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:38.682251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c65cbff-4x24w" event={"ID":"788a2cf7-5eae-450e-979a-56970d87d728","Type":"ContainerStarted","Data":"bba1be5efcea9d8b82a2ba08aa995db4abd2de7af10d7b4cf764266bbb9cfe49"} Jun 03 20:57:39.688339 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:39.688301 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c65cbff-4x24w" event={"ID":"788a2cf7-5eae-450e-979a-56970d87d728","Type":"ContainerStarted","Data":"cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646"} Jun 03 20:57:39.706182 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:57:39.706137 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-869c65cbff-4x24w" podStartSLOduration=2.309612991 podStartE2EDuration="2.706122383s" totalImagesPullingTime="396.509392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:57:39.704768111 +0000 UTC m=+906.914081342" watchObservedRunningTime="2026-06-03 20:57:39.706122383 +0000 UTC m=+906.915435602" Jun 03 20:58:07.015660 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.015631 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm"] Jun 03 20:58:07.017989 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.017974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.020578 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.020556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 20:58:07.021490 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.021472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 20:58:07.021490 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.021484 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 20:58:07.021618 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.021491 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sg6g7\"" Jun 03 20:58:07.030238 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.030214 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm"] Jun 03 20:58:07.068528 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.068504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg2xs\" (UniqueName: \"kubernetes.io/projected/be34993a-38eb-4504-a61e-63846dcdb0d1-kube-api-access-wg2xs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.068690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.068546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.068690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.068574 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.068690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.068601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be34993a-38eb-4504-a61e-63846dcdb0d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.068690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.068621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.068690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.068689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.169636 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.169757 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg2xs\" (UniqueName: \"kubernetes.io/projected/be34993a-38eb-4504-a61e-63846dcdb0d1-kube-api-access-wg2xs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.169757 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.169757 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.169757 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be34993a-38eb-4504-a61e-63846dcdb0d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.169757 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169746 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.170003 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.169985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.170113 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.170094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.170186 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.170142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.171891 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.171872 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be34993a-38eb-4504-a61e-63846dcdb0d1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.172073 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.172055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be34993a-38eb-4504-a61e-63846dcdb0d1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.178713 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.178694 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg2xs\" (UniqueName: \"kubernetes.io/projected/be34993a-38eb-4504-a61e-63846dcdb0d1-kube-api-access-wg2xs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm\" (UID: \"be34993a-38eb-4504-a61e-63846dcdb0d1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.328335 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.328228 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:07.456320 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.456294 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm"] Jun 03 20:58:07.458182 ip-10-0-130-87 kubenswrapper[2560]: W0603 20:58:07.458152 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe34993a_38eb_4504_a61e_63846dcdb0d1.slice/crio-9c1736f1590fd4a9c8eee007f48d38650efd5a75e9d9f2fd189c910961f0ae1f WatchSource:0}: Error finding container 9c1736f1590fd4a9c8eee007f48d38650efd5a75e9d9f2fd189c910961f0ae1f: Status 404 returned error can't find the container with id 9c1736f1590fd4a9c8eee007f48d38650efd5a75e9d9f2fd189c910961f0ae1f Jun 03 20:58:07.817052 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:07.817022 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" event={"ID":"be34993a-38eb-4504-a61e-63846dcdb0d1","Type":"ContainerStarted","Data":"9c1736f1590fd4a9c8eee007f48d38650efd5a75e9d9f2fd189c910961f0ae1f"} Jun 03 20:58:10.834767 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:10.834720 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" event={"ID":"be34993a-38eb-4504-a61e-63846dcdb0d1","Type":"ContainerStarted","Data":"da27a72cc3e70967271b37a22cbc338440d176fed63219f2963f4f91575c251a"} Jun 03 20:58:11.840492 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:11.840402 2560 generic.go:356] "Generic (PLEG): container finished" podID="be34993a-38eb-4504-a61e-63846dcdb0d1" containerID="da27a72cc3e70967271b37a22cbc338440d176fed63219f2963f4f91575c251a" exitCode=0 Jun 03 20:58:11.840890 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:11.840489 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" event={"ID":"be34993a-38eb-4504-a61e-63846dcdb0d1","Type":"ContainerDied","Data":"da27a72cc3e70967271b37a22cbc338440d176fed63219f2963f4f91575c251a"} Jun 03 20:58:13.852538 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:13.852508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" event={"ID":"be34993a-38eb-4504-a61e-63846dcdb0d1","Type":"ContainerStarted","Data":"a4a2d57dac893918d4a9373df0934645764d7b5bf7865e90d732950e55b7d114"} Jun 03 20:58:13.870836 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:13.870791 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" podStartSLOduration=2.786044667 podStartE2EDuration="7.870774839s" totalImagesPullingTime="3.828500127s" totalInitContainerRuntime="1.256230045s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:13.869227812 +0000 UTC m=+941.078541030" watchObservedRunningTime="2026-06-03 20:58:13.870774839 +0000 UTC m=+941.080088058" Jun 03 20:58:17.328656 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:17.328616 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:17.329017 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:17.328684 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:17.341227 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:17.341200 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:17.887574 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:17.887540 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm" Jun 03 20:58:54.892536 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.892464 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls"] Jun 03 20:58:54.913391 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.913367 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls"] Jun 03 20:58:54.913525 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.913454 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:54.916218 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.916191 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 20:58:54.998077 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.998033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vcwp\" (UniqueName: \"kubernetes.io/projected/7cf9711d-406d-4305-bc61-eb2a204e1e1d-kube-api-access-6vcwp\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:54.998226 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.998083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:54.998226 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.998110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:54.998226 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.998193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf9711d-406d-4305-bc61-eb2a204e1e1d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:54.998381 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.998227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:54.998381 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:54.998252 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-home\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099195 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf9711d-406d-4305-bc61-eb2a204e1e1d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099195 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099443 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-home\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099443 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099299 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vcwp\" (UniqueName: \"kubernetes.io/projected/7cf9711d-406d-4305-bc61-eb2a204e1e1d-kube-api-access-6vcwp\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099443 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099443 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099690 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099756 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-home\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.099756 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.099746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.101460 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.101436 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf9711d-406d-4305-bc61-eb2a204e1e1d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.101778 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.101757 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf9711d-406d-4305-bc61-eb2a204e1e1d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.107419 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.107400 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vcwp\" (UniqueName: \"kubernetes.io/projected/7cf9711d-406d-4305-bc61-eb2a204e1e1d-kube-api-access-6vcwp\") pod \"premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls\" (UID: \"7cf9711d-406d-4305-bc61-eb2a204e1e1d\") " pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.229421 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.229396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:58:55.361666 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:55.361641 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls"] Jun 03 20:58:56.046295 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:56.046247 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" event={"ID":"7cf9711d-406d-4305-bc61-eb2a204e1e1d","Type":"ContainerStarted","Data":"e9bd44f9cfe477979d00cb5b640aa9082c1dd48214941fdcb43213377ed17592"} Jun 03 20:58:56.046750 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:58:56.046306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" event={"ID":"7cf9711d-406d-4305-bc61-eb2a204e1e1d","Type":"ContainerStarted","Data":"f7fc3db583c98e848d5083314c31b824d8d836bbecd553ffffa07d1d8cdc2c54"} Jun 03 20:59:00.069279 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:00.069224 2560 generic.go:356] "Generic (PLEG): container finished" podID="7cf9711d-406d-4305-bc61-eb2a204e1e1d" containerID="e9bd44f9cfe477979d00cb5b640aa9082c1dd48214941fdcb43213377ed17592" exitCode=0 Jun 03 20:59:00.069749 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:00.069299 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" event={"ID":"7cf9711d-406d-4305-bc61-eb2a204e1e1d","Type":"ContainerDied","Data":"e9bd44f9cfe477979d00cb5b640aa9082c1dd48214941fdcb43213377ed17592"} Jun 03 20:59:00.070023 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:00.070005 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:59:01.074922 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:01.074886 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" event={"ID":"7cf9711d-406d-4305-bc61-eb2a204e1e1d","Type":"ContainerStarted","Data":"251fc5f8b8a75abb56171e9198a26132ae7e1c92c2234f63999f6d9be7a862ba"} Jun 03 20:59:01.095721 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:01.095674 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" podStartSLOduration=2.668805527 podStartE2EDuration="7.095657455s" totalImagesPullingTime="216.9124ms" totalInitContainerRuntime="4.209939528s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:59:01.093863692 +0000 UTC m=+988.303176911" watchObservedRunningTime="2026-06-03 20:59:01.095657455 +0000 UTC m=+988.304970673" Jun 03 20:59:05.230087 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:05.230054 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:59:05.230518 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:05.230103 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:59:05.242619 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:05.242600 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 20:59:06.107069 ip-10-0-130-87 kubenswrapper[2560]: I0603 20:59:06.107039 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls" Jun 03 21:00:02.865594 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:02.865560 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7578958f7d-wljqh"] Jun 03 21:00:02.868914 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:02.868897 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:02.879289 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:02.879250 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7578958f7d-wljqh"] Jun 03 21:00:02.991451 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:02.991415 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvz2\" (UniqueName: \"kubernetes.io/projected/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-kube-api-access-bqvz2\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:02.991609 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:02.991462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-oidc-ca\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:02.991609 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:02.991539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-tls-cert\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.092371 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.092337 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-oidc-ca\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.092559 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.092406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-tls-cert\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.092559 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.092515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvz2\" (UniqueName: \"kubernetes.io/projected/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-kube-api-access-bqvz2\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.092988 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.092969 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-oidc-ca\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.094772 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.094752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-tls-cert\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.100971 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.100943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvz2\" (UniqueName: \"kubernetes.io/projected/bf68b129-ebfe-45fd-b93a-ec513ae95ee8-kube-api-access-bqvz2\") pod \"authorino-7578958f7d-wljqh\" (UID: \"bf68b129-ebfe-45fd-b93a-ec513ae95ee8\") " pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.178266 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.178235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7578958f7d-wljqh" Jun 03 21:00:03.309808 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.309780 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7578958f7d-wljqh"] Jun 03 21:00:03.312125 ip-10-0-130-87 kubenswrapper[2560]: W0603 21:00:03.312101 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf68b129_ebfe_45fd_b93a_ec513ae95ee8.slice/crio-b789f7a732c594899807c29aa96c8a3fd5b5071da77babb8ac27730846c6e59c WatchSource:0}: Error finding container b789f7a732c594899807c29aa96c8a3fd5b5071da77babb8ac27730846c6e59c: Status 404 returned error can't find the container with id b789f7a732c594899807c29aa96c8a3fd5b5071da77babb8ac27730846c6e59c Jun 03 21:00:03.363714 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:03.363684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7578958f7d-wljqh" event={"ID":"bf68b129-ebfe-45fd-b93a-ec513ae95ee8","Type":"ContainerStarted","Data":"b789f7a732c594899807c29aa96c8a3fd5b5071da77babb8ac27730846c6e59c"} Jun 03 21:00:04.371884 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.371792 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7578958f7d-wljqh" event={"ID":"bf68b129-ebfe-45fd-b93a-ec513ae95ee8","Type":"ContainerStarted","Data":"35d6bf2228a05dac83cea918585bf7923611ff4e27704f4e4ffb7780dec0d108"} Jun 03 21:00:04.390777 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.390724 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7578958f7d-wljqh" podStartSLOduration=1.708080499 podStartE2EDuration="2.390706633s" totalImagesPullingTime="682.626134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:00:04.389531549 +0000 UTC m=+1051.598844769" watchObservedRunningTime="2026-06-03 21:00:04.390706633 +0000 UTC m=+1051.600020232" Jun 03 21:00:04.422052 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.422018 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-869c65cbff-4x24w"] Jun 03 21:00:04.422243 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.422219 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-869c65cbff-4x24w" podUID="788a2cf7-5eae-450e-979a-56970d87d728" containerName="authorino" containerID="cri-o://cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646" gracePeriod=30 Jun 03 21:00:04.676154 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.676130 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 21:00:04.808248 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.808205 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t474g\" (UniqueName: \"kubernetes.io/projected/788a2cf7-5eae-450e-979a-56970d87d728-kube-api-access-t474g\") pod \"788a2cf7-5eae-450e-979a-56970d87d728\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " Jun 03 21:00:04.808446 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.808278 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/788a2cf7-5eae-450e-979a-56970d87d728-tls-cert\") pod \"788a2cf7-5eae-450e-979a-56970d87d728\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " Jun 03 21:00:04.808446 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.808338 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/788a2cf7-5eae-450e-979a-56970d87d728-oidc-ca\") pod \"788a2cf7-5eae-450e-979a-56970d87d728\" (UID: \"788a2cf7-5eae-450e-979a-56970d87d728\") " Jun 03 21:00:04.810490 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.810457 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/788a2cf7-5eae-450e-979a-56970d87d728-kube-api-access-t474g" (OuterVolumeSpecName: "kube-api-access-t474g") pod "788a2cf7-5eae-450e-979a-56970d87d728" (UID: "788a2cf7-5eae-450e-979a-56970d87d728"). InnerVolumeSpecName "kube-api-access-t474g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:00:04.813367 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.813341 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/788a2cf7-5eae-450e-979a-56970d87d728-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "788a2cf7-5eae-450e-979a-56970d87d728" (UID: "788a2cf7-5eae-450e-979a-56970d87d728"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:00:04.818184 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.818158 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/788a2cf7-5eae-450e-979a-56970d87d728-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "788a2cf7-5eae-450e-979a-56970d87d728" (UID: "788a2cf7-5eae-450e-979a-56970d87d728"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:00:04.909946 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.909868 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t474g\" (UniqueName: \"kubernetes.io/projected/788a2cf7-5eae-450e-979a-56970d87d728-kube-api-access-t474g\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 21:00:04.909946 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.909897 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/788a2cf7-5eae-450e-979a-56970d87d728-tls-cert\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 21:00:04.909946 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:04.909906 2560 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/788a2cf7-5eae-450e-979a-56970d87d728-oidc-ca\") on node \"ip-10-0-130-87.ec2.internal\" DevicePath \"\"" Jun 03 21:00:05.377940 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.377905 2560 generic.go:356] "Generic (PLEG): container finished" podID="788a2cf7-5eae-450e-979a-56970d87d728" containerID="cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646" exitCode=0 Jun 03 21:00:05.378352 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.377950 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869c65cbff-4x24w" Jun 03 21:00:05.378352 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.377945 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c65cbff-4x24w" event={"ID":"788a2cf7-5eae-450e-979a-56970d87d728","Type":"ContainerDied","Data":"cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646"} Jun 03 21:00:05.378352 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.378060 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869c65cbff-4x24w" event={"ID":"788a2cf7-5eae-450e-979a-56970d87d728","Type":"ContainerDied","Data":"bba1be5efcea9d8b82a2ba08aa995db4abd2de7af10d7b4cf764266bbb9cfe49"} Jun 03 21:00:05.378352 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.378077 2560 scope.go:117] "RemoveContainer" containerID="cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646" Jun 03 21:00:05.387365 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.387346 2560 scope.go:117] "RemoveContainer" containerID="cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646" Jun 03 21:00:05.387657 ip-10-0-130-87 kubenswrapper[2560]: E0603 21:00:05.387640 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646\": container with ID starting with cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646 not found: ID does not exist" containerID="cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646" Jun 03 21:00:05.387703 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.387666 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646"} err="failed to get container status \"cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646\": rpc error: code = NotFound desc = could not find container \"cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646\": container with ID starting with cf3bbbe7e1bbf85c8d2f929b2bae271116aaf4d00e2739f405a2ed0fc01cf646 not found: ID does not exist" Jun 03 21:00:05.406789 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.406767 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-869c65cbff-4x24w"] Jun 03 21:00:05.420986 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:05.420959 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-869c65cbff-4x24w"] Jun 03 21:00:07.216952 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:00:07.216918 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="788a2cf7-5eae-450e-979a-56970d87d728" path="/var/lib/kubelet/pods/788a2cf7-5eae-450e-979a-56970d87d728/volumes" Jun 03 21:02:33.276412 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:02:33.276305 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:02:33.280522 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:02:33.278544 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:07:33.304288 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:07:33.304165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:07:33.315596 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:07:33.315569 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:12:33.339208 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:12:33.339110 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:12:33.344987 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:12:33.344433 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:17:33.368715 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:17:33.368608 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:17:33.373769 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:17:33.373748 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:22:33.403344 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:22:33.403233 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:22:33.407413 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:22:33.404989 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:23:36.566782 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:36.566746 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7578958f7d-wljqh_bf68b129-ebfe-45fd-b93a-ec513ae95ee8/authorino/0.log" Jun 03 21:23:42.570331 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:42.570296 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-z7gxt_03e7efc0-287f-45b2-9eb9-df2ea6a49009/copy-manifests/0.log" Jun 03 21:23:42.577521 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:42.577494 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-z7gxt_03e7efc0-287f-45b2-9eb9-df2ea6a49009/manager/0.log" Jun 03 21:23:42.691700 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:42.691668 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dmcqn_030b4166-450b-424b-94e4-f6c6f00d49cf/postgres/0.log" Jun 03 21:23:43.971428 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:43.971401 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7578958f7d-wljqh_bf68b129-ebfe-45fd-b93a-ec513ae95ee8/authorino/0.log" Jun 03 21:23:44.211364 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:44.211329 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9v5ws_b571c348-17c0-4489-8d87-e4170000e355/manager/0.log" Jun 03 21:23:45.480557 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:45.480531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-9mbfb_9738cf3e-4a64-4c5c-a275-93b453cc7560/kube-auth-proxy/0.log" Jun 03 21:23:46.417608 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:46.417577 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm_be34993a-38eb-4504-a61e-63846dcdb0d1/storage-initializer/0.log" Jun 03 21:23:46.425253 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:46.425232 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wrjqm_be34993a-38eb-4504-a61e-63846dcdb0d1/main/0.log" Jun 03 21:23:46.804238 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:46.804211 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls_7cf9711d-406d-4305-bc61-eb2a204e1e1d/storage-initializer/0.log" Jun 03 21:23:46.815916 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:46.815893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5745bb64b6-4xxls_7cf9711d-406d-4305-bc61-eb2a204e1e1d/main/0.log" Jun 03 21:23:54.592320 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:54.592288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kpkdt_7ba4b789-85ed-4674-9e3b-548ca3d98480/global-pull-secret-syncer/0.log" Jun 03 21:23:54.715120 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:54.715074 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fnhpl_e202f3c2-adcf-427c-9560-95bbe6bd1883/konnectivity-agent/0.log" Jun 03 21:23:54.774756 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:54.774726 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-87.ec2.internal_a9af2032c8cb4ede9403dc8ac964600b/haproxy/0.log" Jun 03 21:23:59.832361 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:59.832318 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7578958f7d-wljqh_bf68b129-ebfe-45fd-b93a-ec513ae95ee8/authorino/0.log" Jun 03 21:23:59.919891 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:23:59.919807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9v5ws_b571c348-17c0-4489-8d87-e4170000e355/manager/0.log" Jun 03 21:24:02.026730 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.026642 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-bjjbx_79d91fb2-d56d-4245-aefc-5877f67425ae/cluster-monitoring-operator/0.log" Jun 03 21:24:02.135930 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.135903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bc77f4dcc-7dm4n_aeb8d734-8966-45de-ac18-87047893f4ed/metrics-server/0.log" Jun 03 21:24:02.197730 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.197703 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gd22_7b565208-0e10-4eeb-bbef-1089258411ef/node-exporter/0.log" Jun 03 21:24:02.220991 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.220964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gd22_7b565208-0e10-4eeb-bbef-1089258411ef/kube-rbac-proxy/0.log" Jun 03 21:24:02.254851 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.254824 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gd22_7b565208-0e10-4eeb-bbef-1089258411ef/init-textfile/0.log" Jun 03 21:24:02.533839 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.533809 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/prometheus/0.log" Jun 03 21:24:02.563668 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.563640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/config-reloader/0.log" Jun 03 21:24:02.594056 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.594030 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/thanos-sidecar/0.log" Jun 03 21:24:02.617580 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.617555 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/kube-rbac-proxy-web/0.log" Jun 03 21:24:02.639133 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.639108 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/kube-rbac-proxy/0.log" Jun 03 21:24:02.677191 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.677165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/kube-rbac-proxy-thanos/0.log" Jun 03 21:24:02.726429 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:02.726403 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1863550b-b2be-4a18-abab-77a15fdf2529/init-config-reloader/0.log" Jun 03 21:24:04.479414 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:04.479381 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-pbt2c_3414b686-fce4-45f7-b17d-f166e77a1421/networking-console-plugin/0.log" Jun 03 21:24:05.144846 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:05.144820 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/2.log" Jun 03 21:24:05.148946 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:05.148924 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-sjfdn_9bfdc206-b0eb-40d8-a755-5d30a15ae819/console-operator/3.log" Jun 03 21:24:07.051077 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.051037 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf"] Jun 03 21:24:07.051599 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.051565 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="788a2cf7-5eae-450e-979a-56970d87d728" containerName="authorino" Jun 03 21:24:07.051599 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.051584 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="788a2cf7-5eae-450e-979a-56970d87d728" containerName="authorino" Jun 03 21:24:07.051709 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.051686 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="788a2cf7-5eae-450e-979a-56970d87d728" containerName="authorino" Jun 03 21:24:07.054672 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.054650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.057704 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.057675 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9m28l\"/\"openshift-service-ca.crt\"" Jun 03 21:24:07.057819 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.057763 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9m28l\"/\"default-dockercfg-vwwch\"" Jun 03 21:24:07.057819 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.057799 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9m28l\"/\"kube-root-ca.crt\"" Jun 03 21:24:07.066633 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.066612 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf"] Jun 03 21:24:07.154729 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.154692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-sys\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.154894 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.154740 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-proc\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.154894 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.154786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-podres\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.154894 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.154804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-lib-modules\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.154894 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.154870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2th\" (UniqueName: \"kubernetes.io/projected/68853f61-87ff-463d-ab00-877070b27604-kube-api-access-hj2th\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255471 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2th\" (UniqueName: \"kubernetes.io/projected/68853f61-87ff-463d-ab00-877070b27604-kube-api-access-hj2th\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255658 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-sys\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255658 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-proc\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255658 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-podres\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255658 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-lib-modules\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255658 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-proc\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255658 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255651 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-sys\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255906 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-podres\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.255906 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.255770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68853f61-87ff-463d-ab00-877070b27604-lib-modules\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.263785 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.263761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2th\" (UniqueName: \"kubernetes.io/projected/68853f61-87ff-463d-ab00-877070b27604-kube-api-access-hj2th\") pod \"perf-node-gather-daemonset-6rrmf\" (UID: \"68853f61-87ff-463d-ab00-877070b27604\") " pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.365044 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.364951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:07.500123 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.500099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf"] Jun 03 21:24:07.502548 ip-10-0-130-87 kubenswrapper[2560]: W0603 21:24:07.502519 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod68853f61_87ff_463d_ab00_877070b27604.slice/crio-9bc14ae41ec080a4b3e3079324abb7ab4b689a07c21c339140242bab4d2261e5 WatchSource:0}: Error finding container 9bc14ae41ec080a4b3e3079324abb7ab4b689a07c21c339140242bab4d2261e5: Status 404 returned error can't find the container with id 9bc14ae41ec080a4b3e3079324abb7ab4b689a07c21c339140242bab4d2261e5 Jun 03 21:24:07.847105 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.847075 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vcmwk_549b6c66-e747-4da5-b0ff-df490e1990e2/dns/0.log" Jun 03 21:24:07.871084 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.871061 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vcmwk_549b6c66-e747-4da5-b0ff-df490e1990e2/kube-rbac-proxy/0.log" Jun 03 21:24:07.956523 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:07.956497 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bq8cm_0a6847a3-4509-4a13-80bf-85dd8124be10/dns-node-resolver/0.log" Jun 03 21:24:08.025370 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:08.025337 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" event={"ID":"68853f61-87ff-463d-ab00-877070b27604","Type":"ContainerStarted","Data":"aa0d792ff86b81a816985d2e4e813ba373aa422aa99bd67c3588e7c6f4e81b76"} Jun 03 21:24:08.025539 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:08.025387 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" event={"ID":"68853f61-87ff-463d-ab00-877070b27604","Type":"ContainerStarted","Data":"9bc14ae41ec080a4b3e3079324abb7ab4b689a07c21c339140242bab4d2261e5"} Jun 03 21:24:08.025539 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:08.025482 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:08.044334 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:08.044287 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" podStartSLOduration=1.044271212 podStartE2EDuration="1.044271212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:24:08.042186272 +0000 UTC m=+2495.251499493" watchObservedRunningTime="2026-06-03 21:24:08.044271212 +0000 UTC m=+2495.253584427" Jun 03 21:24:08.667390 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:08.667363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vpmsl_1e19f7ae-dc41-4e49-b49b-03b8717d2aba/node-ca/0.log" Jun 03 21:24:09.798938 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:09.798908 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-9mbfb_9738cf3e-4a64-4c5c-a275-93b453cc7560/kube-auth-proxy/0.log" Jun 03 21:24:10.693060 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:10.693030 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6xpjb_73828f80-e5e7-42ff-9316-2d044649c38a/serve-healthcheck-canary/0.log" Jun 03 21:24:11.245606 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:11.245576 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-dtmqt_b6815212-41bf-49f5-9e90-d676cfc64884/insights-operator/0.log" Jun 03 21:24:11.246061 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:11.246039 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-dtmqt_b6815212-41bf-49f5-9e90-d676cfc64884/insights-operator/1.log" Jun 03 21:24:11.406020 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:11.405995 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl2zd_8b663d54-0f5d-4b6c-9268-b3787482baf3/kube-rbac-proxy/0.log" Jun 03 21:24:11.441532 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:11.441511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl2zd_8b663d54-0f5d-4b6c-9268-b3787482baf3/exporter/0.log" Jun 03 21:24:11.464615 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:11.464594 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl2zd_8b663d54-0f5d-4b6c-9268-b3787482baf3/extractor/0.log" Jun 03 21:24:14.039575 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:14.039543 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9m28l/perf-node-gather-daemonset-6rrmf" Jun 03 21:24:14.426121 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:14.426098 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-z7gxt_03e7efc0-287f-45b2-9eb9-df2ea6a49009/manager/0.log" Jun 03 21:24:14.446219 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:14.446202 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd65c64b-z7gxt_03e7efc0-287f-45b2-9eb9-df2ea6a49009/copy-manifests/0.log" Jun 03 21:24:14.471411 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:14.471390 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dmcqn_030b4166-450b-424b-94e4-f6c6f00d49cf/postgres/0.log" Jun 03 21:24:16.151921 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:16.151897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b58f58db9-jgwzw_9d2a6335-1251-4845-aeb5-735362b38f54/manager/0.log" Jun 03 21:24:19.875681 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:19.875652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-9mbfb_9738cf3e-4a64-4c5c-a275-93b453cc7560/kube-auth-proxy/0.log" Jun 03 21:24:21.296834 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:21.296798 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-9mbfb_9738cf3e-4a64-4c5c-a275-93b453cc7560/kube-auth-proxy/0.log" Jun 03 21:24:22.101204 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:22.101177 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rhnjs_a3f9b8c4-716c-4041-a9d3-ee08579c3e38/migrator/0.log" Jun 03 21:24:22.123794 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:22.123761 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rhnjs_a3f9b8c4-716c-4041-a9d3-ee08579c3e38/graceful-termination/0.log" Jun 03 21:24:22.547771 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:22.547735 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2_c7c359a9-87d0-45bc-a248-c71737339828/kube-storage-version-migrator-operator/1.log" Jun 03 21:24:22.548739 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:22.548709 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-b7zn2_c7c359a9-87d0-45bc-a248-c71737339828/kube-storage-version-migrator-operator/0.log" Jun 03 21:24:23.371580 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.371507 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6b976dd-9mbfb_9738cf3e-4a64-4c5c-a275-93b453cc7560/kube-auth-proxy/0.log" Jun 03 21:24:23.779930 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.779898 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-25nzd_ac49226b-7f3f-4edf-87bd-a253b10c5af2/kube-multus/0.log" Jun 03 21:24:23.806388 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.806362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/kube-multus-additional-cni-plugins/0.log" Jun 03 21:24:23.825997 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.825977 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/egress-router-binary-copy/0.log" Jun 03 21:24:23.846234 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.846212 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/cni-plugins/0.log" Jun 03 21:24:23.865828 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.865805 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/bond-cni-plugin/0.log" Jun 03 21:24:23.885789 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.885770 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/routeoverride-cni/0.log" Jun 03 21:24:23.904762 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.904739 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/whereabouts-cni-bincopy/0.log" Jun 03 21:24:23.926581 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:23.926550 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lst7_68742992-94ab-4239-a62b-e79345940fb7/whereabouts-cni/0.log" Jun 03 21:24:24.426099 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:24.426073 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h4mvp_5e7bf515-83c9-4908-bc40-091d45e0f00a/network-metrics-daemon/0.log" Jun 03 21:24:24.445139 ip-10-0-130-87 kubenswrapper[2560]: I0603 21:24:24.445117 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h4mvp_5e7bf515-83c9-4908-bc40-091d45e0f00a/kube-rbac-proxy/0.log"