Jul 23 15:17:34.601479 ip-10-0-139-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 15:17:34.601489 ip-10-0-139-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 15:17:34.601496 ip-10-0-139-153 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 15:17:34.601713 ip-10-0-139-153 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 15:17:45.951592 ip-10-0-139-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 23 15:17:45.951607 ip-10-0-139-153 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e1274709680d496d9c312ee1c0471f9c -- Jul 23 15:19:44.761566 ip-10-0-139-153 systemd[1]: Starting Kubernetes Kubelet... Jul 23 15:19:45.167484 ip-10-0-139-153 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 15:19:45.167484 ip-10-0-139-153 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 15:19:45.167484 ip-10-0-139-153 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 15:19:45.167484 ip-10-0-139-153 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 15:19:45.167484 ip-10-0-139-153 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 15:19:45.168184 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.167549 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 15:19:45.175527 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175501 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:19:45.175527 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175523 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:19:45.175527 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175528 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:19:45.175527 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175531 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:19:45.175527 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175535 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175538 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175541 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175544 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175546 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175550 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175552 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175555 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175557 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175560 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175562 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175566 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175570 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175573 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175576 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175580 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175583 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175586 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175589 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175592 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:19:45.175743 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175595 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175600 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175603 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175606 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175609 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175612 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175614 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175617 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175619 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175622 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175624 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175627 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175629 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175632 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175635 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175638 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175640 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175643 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175645 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175648 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:19:45.176259 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175650 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175653 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175656 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175658 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175661 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175665 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175668 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175671 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175674 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175677 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175679 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175682 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175685 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175688 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175691 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175694 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175696 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175699 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175701 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:19:45.176764 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175703 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175706 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175708 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175711 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175713 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175716 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175719 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175723 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175725 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175728 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175730 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175733 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175735 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175738 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175741 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175744 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175747 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175750 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175752 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175755 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:19:45.177215 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175759 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175761 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175764 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175766 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175769 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175771 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175774 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175776 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175778 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175781 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175784 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175786 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175789 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175791 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175794 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.175796 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176575 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176583 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176588 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176591 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:19:45.177706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176595 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176598 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176601 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176606 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176609 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176612 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176615 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176618 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176620 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176623 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176626 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176628 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176632 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176640 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176644 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176647 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176649 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176652 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176654 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:19:45.178183 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176657 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176659 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176662 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176664 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176668 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176670 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176673 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176675 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176678 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176680 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176683 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176685 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176688 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176691 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176694 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176696 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176699 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176701 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176704 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176706 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:19:45.178705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176709 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176711 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176714 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176716 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176719 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176721 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176724 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176727 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176729 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176732 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176734 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176737 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176739 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176742 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176744 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176746 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176749 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176751 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176753 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176756 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176758 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:19:45.179194 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176760 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176763 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176766 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176769 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176771 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176774 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176777 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176779 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176783 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176786 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176788 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176792 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176795 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176797 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176800 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176802 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176805 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176807 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:19:45.179737 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176810 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176812 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176815 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176817 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176820 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176822 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176824 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176827 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176830 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176832 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176834 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176837 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176840 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176842 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176844 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176847 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.176849 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177235 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177240 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177243 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:19:45.180181 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177245 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177248 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177250 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177254 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177258 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177281 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177285 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177288 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177290 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177293 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177295 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177298 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177300 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177304 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177307 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177309 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177311 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177314 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177317 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:19:45.180690 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177319 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177323 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177325 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177328 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177331 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177333 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177336 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177338 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177341 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177343 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177346 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177348 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177351 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177353 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177356 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177358 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177360 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177363 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177365 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177368 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:19:45.181139 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177370 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177372 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177375 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177377 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177379 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177382 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177384 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177388 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177390 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177393 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177395 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177397 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177400 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177403 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177406 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177408 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177411 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177413 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177416 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177418 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:19:45.181648 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177420 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177423 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177425 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177429 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177432 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177436 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177439 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177441 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177444 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177447 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177450 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177453 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177455 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177458 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177462 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177465 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177468 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177470 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177473 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:19:45.182132 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177475 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177479 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177481 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177484 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177487 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177490 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177492 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177495 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177497 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177500 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177502 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177505 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177507 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177510 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177512 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177515 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177517 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.177519 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177610 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177628 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177634 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 15:19:45.182692 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177639 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177643 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177646 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177650 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177655 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177658 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177660 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177664 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177667 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177670 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177673 2575 flags.go:64] FLAG: --cgroup-root="" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177676 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177679 2575 flags.go:64] FLAG: --client-ca-file="" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177682 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177686 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177690 2575 flags.go:64] FLAG: --cluster-domain="" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177693 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177696 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177699 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177703 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177706 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177710 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177713 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 15:19:45.183203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177716 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177719 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177722 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177725 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177728 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177731 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177735 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177738 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177741 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177744 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177746 2575 flags.go:64] FLAG: --enable-server="true" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177750 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177754 2575 flags.go:64] FLAG: --event-burst="100" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177757 2575 flags.go:64] FLAG: --event-qps="50" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177759 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177762 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177766 2575 flags.go:64] FLAG: --eviction-hard="" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177769 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177772 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177775 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177777 2575 flags.go:64] FLAG: --eviction-soft="" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177780 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177783 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177789 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177792 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 15:19:45.183777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177796 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177799 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177802 2575 flags.go:64] FLAG: --feature-gates="" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177805 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177808 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177811 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177814 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177817 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177820 2575 flags.go:64] FLAG: --help="false" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177823 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177826 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177829 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177831 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177835 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177838 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177840 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177843 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177845 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177848 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177851 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177854 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177856 2575 flags.go:64] FLAG: --kube-reserved="" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177859 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177861 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 15:19:45.184457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177864 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177867 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177870 2575 flags.go:64] FLAG: --lock-file="" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177872 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177875 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177878 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177884 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177887 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177892 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177894 2575 flags.go:64] FLAG: --logging-format="text" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177897 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177901 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177904 2575 flags.go:64] FLAG: --manifest-url="" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177906 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177910 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177913 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177917 2575 flags.go:64] FLAG: --max-pods="110" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177920 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177923 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177926 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177929 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177931 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177934 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177937 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177944 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 15:19:45.185031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177947 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177950 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177953 2575 flags.go:64] FLAG: --pod-cidr="" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177955 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177961 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177963 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177966 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177969 2575 flags.go:64] FLAG: --port="10250" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177972 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177974 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f4faa94442a6237e" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177977 2575 flags.go:64] FLAG: --qos-reserved="" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177980 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177983 2575 flags.go:64] FLAG: --register-node="true" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177986 2575 flags.go:64] FLAG: --register-with-taints="" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177992 2575 flags.go:64] FLAG: --registry-burst="10" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.177997 2575 flags.go:64] FLAG: --registry-qps="5" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178000 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178003 2575 flags.go:64] FLAG: --reserved-memory="" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178006 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178009 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178012 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178014 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178017 2575 flags.go:64] FLAG: --runonce="false" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178020 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178022 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 15:19:45.185665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178025 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178028 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178031 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178034 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178036 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178039 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178042 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178044 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178047 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178050 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178052 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178055 2575 flags.go:64] FLAG: --system-cgroups="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178058 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178063 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178066 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178068 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178073 2575 flags.go:64] FLAG: --tls-min-version="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178075 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178078 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178080 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178083 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178087 2575 flags.go:64] FLAG: --v="2" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178094 2575 flags.go:64] FLAG: --version="false" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178099 2575 flags.go:64] FLAG: --vmodule="" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178102 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 15:19:45.186281 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178105 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178229 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178233 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178236 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178239 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178242 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178245 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178247 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178250 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178253 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178255 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178257 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178276 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178281 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178283 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178286 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178289 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178292 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178294 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178297 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:19:45.186901 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178300 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178302 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178304 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178307 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178310 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178313 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178316 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178318 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178322 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178327 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178330 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178333 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178336 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178339 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178341 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178344 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178346 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178349 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178351 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178353 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:19:45.187450 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178356 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178358 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178361 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178363 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178366 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178369 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178373 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178376 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178379 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178382 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178385 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178387 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178390 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178392 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178395 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178398 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178401 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178403 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178405 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:19:45.187969 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178408 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178412 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178415 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178418 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178420 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178423 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178426 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178428 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178431 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178433 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178437 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178440 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178443 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178446 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178448 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178451 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178453 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178456 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178458 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:19:45.188460 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178461 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178463 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178466 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178468 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178471 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178473 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178475 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178478 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178480 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178483 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178485 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178487 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178490 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178492 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178497 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178501 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178505 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178508 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178510 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:19:45.188912 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178513 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178516 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.178518 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.178527 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.185576 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.185597 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.186576 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.186588 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186649 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186655 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186659 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186662 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186664 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186669 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:19:45.189407 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186673 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186675 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186678 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186681 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186683 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186686 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186689 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186691 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186694 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186696 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186698 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186701 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186705 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186709 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186712 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186714 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186718 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186720 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186722 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186725 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:19:45.189762 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186727 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186730 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186732 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186736 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186740 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186742 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186745 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186747 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186750 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186752 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186755 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186757 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186760 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186762 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186765 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186767 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186770 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186772 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186775 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186777 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:19:45.190274 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186780 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186782 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186785 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186787 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186790 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186792 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186794 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186797 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186799 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186802 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186804 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186807 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186809 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186812 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186814 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186817 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186820 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186823 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186826 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186828 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:19:45.190780 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186831 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186833 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186836 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186838 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186840 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186843 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186845 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186848 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186851 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186853 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186856 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186858 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186860 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186863 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186865 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186869 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186872 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186875 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186878 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:19:45.191309 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186881 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186883 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186886 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186888 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186891 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186894 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186896 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186899 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186903 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186906 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186909 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186912 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186914 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.186917 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.186922 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 15:19:45.191783 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187038 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187042 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187045 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187048 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187051 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187054 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187057 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187060 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187064 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187068 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187071 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187074 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187077 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187080 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187082 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187085 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187087 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187089 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187092 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:19:45.192153 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187094 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187097 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187099 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187102 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187104 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187107 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187109 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187112 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187114 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187117 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187120 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187122 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187124 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187127 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187129 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187132 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187134 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187138 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187141 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:19:45.192644 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187144 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187147 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187149 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187152 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187154 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187157 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187160 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187162 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187165 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187167 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187169 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187172 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187174 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187177 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187179 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187181 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187184 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187186 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187189 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187191 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:19:45.193106 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187194 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187196 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187198 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187201 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187204 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187206 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187209 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187211 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187214 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187216 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187220 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187223 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187226 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187228 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187231 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187234 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187236 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187239 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187241 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:19:45.193712 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187244 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187247 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187249 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187251 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187254 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187256 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187259 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187278 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187282 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187284 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187287 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187289 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187292 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187294 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187297 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187300 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187302 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187305 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187308 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187310 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:19:45.194182 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187313 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:45.187315 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.187321 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.187459 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.189437 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.190709 2575 server.go:1019] "Starting client certificate rotation" Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.190820 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.190852 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 15:19:45.194694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.193291 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 15:19:45.194991 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.194977 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 15:19:45.204529 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.204502 2575 log.go:25] "Validated CRI v1 runtime API" Jul 23 15:19:45.207609 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.207583 2575 log.go:25] "Validated CRI v1 image API" Jul 23 15:19:45.209188 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.209164 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 15:19:45.211953 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.211916 2575 fs.go:135] Filesystem UUIDs: map[16a7293b-0f84-483c-99cc-f480b06cd77a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a12280d5-6289-4efa-aec0-a23cde6cac35:/dev/nvme0n1p3] Jul 23 15:19:45.212034 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.211951 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 15:19:45.218890 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.218757 2575 manager.go:216] Machine: {Timestamp:2026-07-23 15:19:45.217195426 +0000 UTC m=+0.338240357 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128147 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f5b6fcfefabdad5d709d6e1f8f016 SystemUUID:ec2f5b6f-cfef-abda-d5d7-09d6e1f8f016 BootID:e1274709-680d-496d-9c31-2ee1c0471f9c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:28:6b:5b:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:28:6b:5b:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:e2:25:c7:bc:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 15:19:45.218890 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.218877 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 15:19:45.219050 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.218979 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 15:19:45.221005 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.220969 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 15:19:45.221249 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.221010 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 15:19:45.222310 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.222292 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 15:19:45.222370 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.222317 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 15:19:45.222370 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.222329 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 15:19:45.223092 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.223077 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 15:19:45.224397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.224381 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 15:19:45.228206 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228187 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 15:19:45.228401 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228381 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 15:19:45.228478 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228421 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 15:19:45.228478 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228456 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 23 15:19:45.228478 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228473 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 15:19:45.228606 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228490 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 15:19:45.228606 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228505 2575 kubelet.go:398] "Adding apiserver pod source" Jul 23 15:19:45.228606 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228521 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 15:19:45.228970 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228955 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 15:19:45.229049 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.228980 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 15:19:45.231349 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.231330 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 15:19:45.233319 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.233304 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 15:19:45.233387 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.233335 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 15:19:45.234868 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234856 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 15:19:45.234907 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234873 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 15:19:45.234907 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234879 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 15:19:45.234907 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234885 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 15:19:45.234907 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234894 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 15:19:45.234907 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234900 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 15:19:45.234907 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234908 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 15:19:45.235059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234914 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 15:19:45.235059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234920 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 15:19:45.235059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234925 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 15:19:45.235059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234944 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 15:19:45.235059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.234950 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 15:19:45.235795 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.235782 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 15:19:45.235835 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.235798 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 15:19:45.239527 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.239511 2575 server.go:1268] "Started kubelet" Jul 23 15:19:45.239661 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.239604 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 15:19:45.242613 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.242581 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 15:19:45.243131 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.243099 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 15:19:45.243240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.243129 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 15:19:45.243240 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.243130 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 15:19:45.243240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.239625 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 15:19:45.243473 ip-10-0-139-153 systemd[1]: Started Kubernetes Kubelet. Jul 23 15:19:45.245420 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.245395 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 15:19:45.246810 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.246787 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 23 15:19:45.248648 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.248626 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 15:19:45.250364 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.249245 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-153.ec2.internal.18c4f451f8379b9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-153.ec2.internal,UID:ip-10-0-139-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-153.ec2.internal,},FirstTimestamp:2026-07-23 15:19:45.239481245 +0000 UTC m=+0.360526205,LastTimestamp:2026-07-23 15:19:45.239481245 +0000 UTC m=+0.360526205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-153.ec2.internal,}" Jul 23 15:19:45.253526 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.253507 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 15:19:45.253625 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.253525 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 15:19:45.253698 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.253651 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.254328 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254307 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 15:19:45.254328 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254328 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 15:19:45.254453 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254293 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 15:19:45.254500 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254485 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 23 15:19:45.254549 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254503 2575 factory.go:55] Registering systemd factory Jul 23 15:19:45.254549 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254521 2575 factory.go:223] Registration of the systemd container factory successfully Jul 23 15:19:45.254811 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254506 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 23 15:19:45.254811 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254727 2575 factory.go:153] Registering CRI-O factory Jul 23 15:19:45.254811 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254741 2575 factory.go:223] Registration of the crio container factory successfully Jul 23 15:19:45.254811 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254797 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 15:19:45.254983 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254822 2575 factory.go:103] Registering Raw factory Jul 23 15:19:45.254983 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.254836 2575 manager.go:1196] Started watching for new ooms in manager Jul 23 15:19:45.255570 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.255553 2575 manager.go:349] Starting recovery of all containers Jul 23 15:19:45.257270 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.257243 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2n8x" Jul 23 15:19:45.264455 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.264436 2575 manager.go:354] Recovery completed Jul 23 15:19:45.265469 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.265328 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 15:19:45.265469 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.265384 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 15:19:45.266134 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.266113 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p2n8x" Jul 23 15:19:45.269350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.269335 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.271580 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.271562 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.271653 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.271593 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.271653 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.271604 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.272147 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272130 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 15:19:45.272147 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272138 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.272147 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272144 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 15:19:45.272313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272160 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 15:19:45.272853 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272839 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.272898 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272866 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.272898 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.272875 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.273462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.273386 2575 policy_none.go:49] "None policy: Start" Jul 23 15:19:45.273462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.273398 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 15:19:45.273462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.273409 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 15:19:45.273914 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.273851 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-153.ec2.internal.18c4f451fa215e93 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-153.ec2.internal,UID:ip-10-0-139-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-153.ec2.internal,},FirstTimestamp:2026-07-23 15:19:45.271578259 +0000 UTC m=+0.392623191,LastTimestamp:2026-07-23 15:19:45.271578259 +0000 UTC m=+0.392623191,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-153.ec2.internal,}" Jul 23 15:19:45.274397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.274381 2575 policy_none.go:47] "Start" Jul 23 15:19:45.305872 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.305857 2575 manager.go:337] "Starting Device Plugin manager" Jul 23 15:19:45.305963 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.305889 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 15:19:45.305963 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.305898 2575 server.go:87] "Starting device plugin registration server" Jul 23 15:19:45.306160 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.306147 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 15:19:45.306197 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.306163 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 15:19:45.306309 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.306284 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 15:19:45.306425 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.306359 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 15:19:45.306425 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.306367 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 15:19:45.306908 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.306885 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 15:19:45.306976 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.306945 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.406773 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.406743 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.407949 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.407891 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.407949 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.407925 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.407949 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.407938 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.408086 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.407966 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.417747 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.417698 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.417747 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.417722 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-153.ec2.internal\": node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.431950 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.431928 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.468457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.468421 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 15:19:45.469856 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.469839 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 15:19:45.469940 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.469889 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 15:19:45.469940 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.469918 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 15:19:45.470035 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.469960 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 15:19:45.472507 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.472486 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:19:45.532810 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.532766 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.570342 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.570314 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal"] Jul 23 15:19:45.570423 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.570406 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.572146 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.572127 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.572252 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.572162 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.572252 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.572176 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.573589 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.573576 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.573719 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.573703 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.573771 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.573736 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.574351 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.574333 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.574351 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.574340 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.574518 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.574365 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.574518 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.574379 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.574518 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.574365 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.574518 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.574455 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.575665 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.575648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.575760 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.575678 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:19:45.576402 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.576376 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:19:45.576402 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.576404 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:19:45.576525 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.576414 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:19:45.601058 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.601027 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.605430 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.605412 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.633793 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.633760 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.658222 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.658196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d47012c6139c8962029c67475d5f8a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8d47012c6139c8962029c67475d5f8a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.658222 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.658223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47481dd6419387374d030821f473aa00-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"47481dd6419387374d030821f473aa00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.658380 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.658241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d47012c6139c8962029c67475d5f8a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8d47012c6139c8962029c67475d5f8a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.734050 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.733971 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.758424 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.758394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d47012c6139c8962029c67475d5f8a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8d47012c6139c8962029c67475d5f8a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.758537 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.758429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d47012c6139c8962029c67475d5f8a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8d47012c6139c8962029c67475d5f8a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.758537 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.758449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47481dd6419387374d030821f473aa00-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"47481dd6419387374d030821f473aa00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.758537 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.758511 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d47012c6139c8962029c67475d5f8a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8d47012c6139c8962029c67475d5f8a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.758537 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.758509 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d47012c6139c8962029c67475d5f8a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8d47012c6139c8962029c67475d5f8a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.758682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.758556 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47481dd6419387374d030821f473aa00-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"47481dd6419387374d030821f473aa00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.834570 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.834539 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:45.904072 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.904033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.908700 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:45.908410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 23 15:19:45.935290 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:45.935246 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:47.309186 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.309160 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 23 15:19:47.367724 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.367696 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:19:47.427355 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.427321 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 23 15:19:47.436274 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.436254 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 15:19:47.438444 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.438430 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 23 15:19:47.449969 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.449953 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 15:19:47.464116 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.464098 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 15:19:47.464268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.464245 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 15:19:47.464314 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.464245 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 15:19:47.502418 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.502396 2575 apiserver.go:52] "Watching apiserver" Jul 23 15:19:47.517118 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.517093 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 15:19:47.519121 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.518068 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-rmmzt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal","openshift-network-diagnostics/network-check-target-hf4mp","openshift-network-operator/iptables-alerter-mqxch","kube-system/global-pull-secret-syncer-6p72c","kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh","openshift-image-registry/node-ca-nwmt2","openshift-multus/multus-additional-cni-plugins-68gmr","openshift-multus/multus-ntjrj","openshift-multus/network-metrics-daemon-l5j82","openshift-ovn-kubernetes/ovnkube-node-jxn8b","kube-system/konnectivity-agent-psxwh"] Jul 23 15:19:47.519861 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.519833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.521564 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.521546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:47.521650 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.521621 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:47.522373 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.522352 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 15:19:47.522373 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.522366 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vs9zs\"" Jul 23 15:19:47.522515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.522457 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 15:19:47.522515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.522458 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 15:19:47.522684 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.522669 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.523620 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.523606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.523690 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.523672 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:19:47.524740 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.524722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.524802 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.524772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 15:19:47.525122 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.525102 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fnz76\"" Jul 23 15:19:47.525192 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.525143 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:19:47.525192 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.525146 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 15:19:47.525918 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.525902 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.526820 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.526803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hkvlk\"" Jul 23 15:19:47.526820 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.526814 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 15:19:47.526946 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.526935 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:19:47.527028 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.526986 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 15:19:47.527233 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.527219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.528052 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.528031 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 15:19:47.528138 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.528062 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 15:19:47.528193 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.528147 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 15:19:47.528262 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.528249 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lpgh4\"" Jul 23 15:19:47.528400 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.528386 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.529609 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.529593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:47.529703 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.529681 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:47.529905 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.529892 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 15:19:47.529981 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.529966 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7cp69\"" Jul 23 15:19:47.530277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.530255 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 15:19:47.530367 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.530265 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 15:19:47.530458 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.530443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 15:19:47.530519 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.530443 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rcfsj\"" Jul 23 15:19:47.530519 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.530470 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 15:19:47.530614 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.530529 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 15:19:47.531107 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.531092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.532265 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.532250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.533114 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.533098 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 15:19:47.533173 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.533152 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xqmdp\"" Jul 23 15:19:47.533370 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.533356 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 15:19:47.533438 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.533384 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 15:19:47.533438 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.533391 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 15:19:47.533731 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.533717 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 15:19:47.534128 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534115 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 15:19:47.534580 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534566 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s7dtf\"" Jul 23 15:19:47.534642 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534571 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 15:19:47.534642 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534591 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 15:19:47.534743 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-kubernetes\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.534743 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-tuned\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.534743 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/127a051e-ed78-4bd4-9d27-5279a89cfd1d-tmp\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.534743 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-os-release\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.534884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-registration-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.534884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gdlt\" (UniqueName: \"kubernetes.io/projected/2a920ee6-145f-415e-b8ec-6a7646245184-kube-api-access-4gdlt\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.534884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b37a0c87-f595-452a-8820-8d378af36635-host-slash\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.534884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:47.534884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-host\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.534884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-cnibin\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-run\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-sys\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-conf-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.534991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgslx\" (UniqueName: \"kubernetes.io/projected/db748f9f-5323-4cff-946f-c6f7c48aa290-kube-api-access-cgslx\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-socket-dir-parent\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-kubelet\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-device-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-etc-selinux\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.535098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-modprobe-d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysctl-conf\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/184ad1d7-7c16-42f1-a343-257633bf464e-host\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b37a0c87-f595-452a-8820-8d378af36635-iptables-alerter-script\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-system-cni-dir\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sj7d\" (UniqueName: \"kubernetes.io/projected/127a051e-ed78-4bd4-9d27-5279a89cfd1d-kube-api-access-6sj7d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-etc-kubernetes\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-socket-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-sys-fs\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b28492ba-00b6-47c8-93e7-311e6556d0bd-kubelet-config\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwjj\" (UniqueName: \"kubernetes.io/projected/184ad1d7-7c16-42f1-a343-257633bf464e-kube-api-access-xnwjj\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-os-release\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-cni-bin\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-cni-multus\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a920ee6-145f-415e-b8ec-6a7646245184-multus-daemon-config\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b28492ba-00b6-47c8-93e7-311e6556d0bd-dbus\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysconfig\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-systemd\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-lib-modules\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pd4p\" (UniqueName: \"kubernetes.io/projected/1e66636f-6c89-4bab-9536-cd542ab96d9c-kube-api-access-4pd4p\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.535956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-cni-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.535984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptd6c\" (UniqueName: \"kubernetes.io/projected/b37a0c87-f595-452a-8820-8d378af36635-kube-api-access-ptd6c\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysctl-d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/184ad1d7-7c16-42f1-a343-257633bf464e-serviceca\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-cnibin\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-hostroot\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536244 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-multus-certs\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-var-lib-kubelet\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.536542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-system-cni-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a920ee6-145f-415e-b8ec-6a7646245184-cni-binary-copy\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-k8s-cni-cncf-io\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.536542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.536459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-netns\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.541811 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.541553 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 15:19:47.543636 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.543592 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 15:14:46 +0000 UTC" deadline="2027-12-24 11:08:55.210495075 +0000 UTC" Jul 23 15:19:47.543692 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.543636 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12451h49m7.666861172s" Jul 23 15:19:47.566224 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.566202 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8qmwp" Jul 23 15:19:47.577620 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.577597 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8qmwp" Jul 23 15:19:47.628686 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.628645 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 15:19:47.637501 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-os-release\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637615 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-cni-bin\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637615 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.637615 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-cni-multus\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637615 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637610 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-os-release\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637611 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-cni-multus\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637635 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-cni-bin\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a920ee6-145f-415e-b8ec-6a7646245184-multus-daemon-config\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637707 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-env-overrides\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa45590e-a975-44f6-97ae-1b6698141974-konnectivity-ca\") pod \"konnectivity-agent-psxwh\" (UID: \"fa45590e-a975-44f6-97ae-1b6698141974\") " pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b28492ba-00b6-47c8-93e7-311e6556d0bd-dbus\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysconfig\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637794 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-systemd\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.637816 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-lib-modules\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pd4p\" (UniqueName: \"kubernetes.io/projected/1e66636f-6c89-4bab-9536-cd542ab96d9c-kube-api-access-4pd4p\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637861 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysconfig\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-cni-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-systemd\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptd6c\" (UniqueName: \"kubernetes.io/projected/b37a0c87-f595-452a-8820-8d378af36635-kube-api-access-ptd6c\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b28492ba-00b6-47c8-93e7-311e6556d0bd-dbus\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysctl-d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/184ad1d7-7c16-42f1-a343-257633bf464e-serviceca\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-cni-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-lib-modules\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.637995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-cnibin\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-cnibin\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysctl-d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-hostroot\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638376 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-hostroot\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-multus-certs\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638421 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-multus-certs\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-etc-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/184ad1d7-7c16-42f1-a343-257633bf464e-serviceca\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-ovn\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638497 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-var-lib-kubelet\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-system-cni-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638550 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a920ee6-145f-415e-b8ec-6a7646245184-cni-binary-copy\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-var-lib-kubelet\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-k8s-cni-cncf-io\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-log-socket\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638598 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-system-cni-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-ovnkube-script-lib\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.638737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-k8s-cni-cncf-io\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638649 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-netns\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-var-lib-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-run-netns\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-node-log\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-ovnkube-config\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-kubernetes\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-tuned\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638788 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2a920ee6-145f-415e-b8ec-6a7646245184-multus-daemon-config\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/127a051e-ed78-4bd4-9d27-5279a89cfd1d-tmp\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-os-release\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638846 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-kubernetes\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-systemd-units\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-registration-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gdlt\" (UniqueName: \"kubernetes.io/projected/2a920ee6-145f-415e-b8ec-6a7646245184-kube-api-access-4gdlt\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b37a0c87-f595-452a-8820-8d378af36635-host-slash\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-os-release\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.639522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrzg\" (UniqueName: \"kubernetes.io/projected/4359259a-6b2e-445c-aee7-db07a6bb35d9-kube-api-access-wtrzg\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-registration-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638960 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a920ee6-145f-415e-b8ec-6a7646245184-cni-binary-copy\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.638983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-run-netns\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b37a0c87-f595-452a-8820-8d378af36635-host-slash\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-host\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-cnibin\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-host\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-cnibin\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-slash\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-cni-bin\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-cni-netd\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa45590e-a975-44f6-97ae-1b6698141974-agent-certs\") pod \"konnectivity-agent-psxwh\" (UID: \"fa45590e-a975-44f6-97ae-1b6698141974\") " pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-run\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-sys\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-conf-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-run\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56595aba-438b-4c13-87b1-f258016eab45-ovn-node-metrics-cert\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgslx\" (UniqueName: \"kubernetes.io/projected/db748f9f-5323-4cff-946f-c6f7c48aa290-kube-api-access-cgslx\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-sys\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-socket-dir-parent\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-conf-dir\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-kubelet\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639385 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-device-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-etc-selinux\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639441 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-multus-socket-dir-parent\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639427 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-host-var-lib-kubelet\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639464 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-device-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-modprobe-d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.639533 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:47.640869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysctl-conf\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/184ad1d7-7c16-42f1-a343-257633bf464e-host\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b37a0c87-f595-452a-8820-8d378af36635-iptables-alerter-script\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.639618 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:19:48.13959655 +0000 UTC m=+1.987250066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639618 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-modprobe-d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639538 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-etc-selinux\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-systemd\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639683 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/184ad1d7-7c16-42f1-a343-257633bf464e-host\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-kubelet\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-sysctl-conf\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-system-cni-dir\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639809 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-system-cni-dir\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9v2j\" (UniqueName: \"kubernetes.io/projected/56595aba-438b-4c13-87b1-f258016eab45-kube-api-access-g9v2j\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639820 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e66636f-6c89-4bab-9536-cd542ab96d9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.641449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sj7d\" (UniqueName: \"kubernetes.io/projected/127a051e-ed78-4bd4-9d27-5279a89cfd1d-kube-api-access-6sj7d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-etc-kubernetes\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639919 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a920ee6-145f-415e-b8ec-6a7646245184-etc-kubernetes\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.639989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-socket-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-sys-fs\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640073 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-sys-fs\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b37a0c87-f595-452a-8820-8d378af36635-iptables-alerter-script\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b28492ba-00b6-47c8-93e7-311e6556d0bd-kubelet-config\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwjj\" (UniqueName: \"kubernetes.io/projected/184ad1d7-7c16-42f1-a343-257633bf464e-kube-api-access-xnwjj\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640146 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db748f9f-5323-4cff-946f-c6f7c48aa290-socket-dir\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640159 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b28492ba-00b6-47c8-93e7-311e6556d0bd-kubelet-config\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:47.641956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.640606 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e66636f-6c89-4bab-9536-cd542ab96d9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.642344 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.642255 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/127a051e-ed78-4bd4-9d27-5279a89cfd1d-etc-tuned\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.642344 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.642276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/127a051e-ed78-4bd4-9d27-5279a89cfd1d-tmp\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.647030 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.646990 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:19:47.647030 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.647031 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:19:47.647214 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.647044 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:47.647214 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.647108 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:19:48.147091396 +0000 UTC m=+1.994744928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:47.648802 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.648776 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptd6c\" (UniqueName: \"kubernetes.io/projected/b37a0c87-f595-452a-8820-8d378af36635-kube-api-access-ptd6c\") pod \"iptables-alerter-mqxch\" (UID: \"b37a0c87-f595-452a-8820-8d378af36635\") " pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.648917 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.648835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgslx\" (UniqueName: \"kubernetes.io/projected/db748f9f-5323-4cff-946f-c6f7c48aa290-kube-api-access-cgslx\") pod \"aws-ebs-csi-driver-node-s9bgh\" (UID: \"db748f9f-5323-4cff-946f-c6f7c48aa290\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.648983 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.648965 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pd4p\" (UniqueName: \"kubernetes.io/projected/1e66636f-6c89-4bab-9536-cd542ab96d9c-kube-api-access-4pd4p\") pod \"multus-additional-cni-plugins-68gmr\" (UID: \"1e66636f-6c89-4bab-9536-cd542ab96d9c\") " pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.651928 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.651905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gdlt\" (UniqueName: \"kubernetes.io/projected/2a920ee6-145f-415e-b8ec-6a7646245184-kube-api-access-4gdlt\") pod \"multus-ntjrj\" (UID: \"2a920ee6-145f-415e-b8ec-6a7646245184\") " pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.653523 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.653504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwjj\" (UniqueName: \"kubernetes.io/projected/184ad1d7-7c16-42f1-a343-257633bf464e-kube-api-access-xnwjj\") pod \"node-ca-nwmt2\" (UID: \"184ad1d7-7c16-42f1-a343-257633bf464e\") " pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.653649 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.653628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sj7d\" (UniqueName: \"kubernetes.io/projected/127a051e-ed78-4bd4-9d27-5279a89cfd1d-kube-api-access-6sj7d\") pod \"tuned-rmmzt\" (UID: \"127a051e-ed78-4bd4-9d27-5279a89cfd1d\") " pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.740942 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.740902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-systemd\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.740942 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.740947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.740969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-kubelet\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.740989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741016 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-systemd\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9v2j\" (UniqueName: \"kubernetes.io/projected/56595aba-438b-4c13-87b1-f258016eab45-kube-api-access-g9v2j\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-kubelet\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.741085 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-env-overrides\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741212 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:47.741222 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:19:48.241202362 +0000 UTC m=+2.088855894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa45590e-a975-44f6-97ae-1b6698141974-konnectivity-ca\") pod \"konnectivity-agent-psxwh\" (UID: \"fa45590e-a975-44f6-97ae-1b6698141974\") " pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-etc-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-ovn\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-log-socket\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-ovnkube-script-lib\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-etc-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-var-lib-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-run-ovn\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741421 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-var-lib-openvswitch\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-node-log\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741589 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-ovnkube-config\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-node-log\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-env-overrides\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-systemd-units\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-systemd-units\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-log-socket\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.741870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.741849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrzg\" (UniqueName: \"kubernetes.io/projected/4359259a-6b2e-445c-aee7-db07a6bb35d9-kube-api-access-wtrzg\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-run-netns\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742116 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-ovnkube-config\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742126 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-run-netns\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa45590e-a975-44f6-97ae-1b6698141974-konnectivity-ca\") pod \"konnectivity-agent-psxwh\" (UID: \"fa45590e-a975-44f6-97ae-1b6698141974\") " pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-slash\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-cni-bin\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-cni-netd\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa45590e-a975-44f6-97ae-1b6698141974-agent-certs\") pod \"konnectivity-agent-psxwh\" (UID: \"fa45590e-a975-44f6-97ae-1b6698141974\") " pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742235 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-cni-bin\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742237 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-slash\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742236 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56595aba-438b-4c13-87b1-f258016eab45-ovnkube-script-lib\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56595aba-438b-4c13-87b1-f258016eab45-ovn-node-metrics-cert\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.742597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.742279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56595aba-438b-4c13-87b1-f258016eab45-host-cni-netd\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.744589 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.744565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56595aba-438b-4c13-87b1-f258016eab45-ovn-node-metrics-cert\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.744726 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.744608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa45590e-a975-44f6-97ae-1b6698141974-agent-certs\") pod \"konnectivity-agent-psxwh\" (UID: \"fa45590e-a975-44f6-97ae-1b6698141974\") " pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.750013 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.749994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrzg\" (UniqueName: \"kubernetes.io/projected/4359259a-6b2e-445c-aee7-db07a6bb35d9-kube-api-access-wtrzg\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:47.750206 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.750189 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9v2j\" (UniqueName: \"kubernetes.io/projected/56595aba-438b-4c13-87b1-f258016eab45-kube-api-access-g9v2j\") pod \"ovnkube-node-jxn8b\" (UID: \"56595aba-438b-4c13-87b1-f258016eab45\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.757860 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.757831 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47481dd6419387374d030821f473aa00.slice/crio-5d3e96cab1fa8754033bdd97341188f5c4f7f1d09a88ee198d6889138677bfca WatchSource:0}: Error finding container 5d3e96cab1fa8754033bdd97341188f5c4f7f1d09a88ee198d6889138677bfca: Status 404 returned error can't find the container with id 5d3e96cab1fa8754033bdd97341188f5c4f7f1d09a88ee198d6889138677bfca Jul 23 15:19:47.758504 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.758486 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d47012c6139c8962029c67475d5f8a9.slice/crio-af358202e679dc4001ac922e1ea9d4b3097bc0da7944c97702f40f99f22a390a WatchSource:0}: Error finding container af358202e679dc4001ac922e1ea9d4b3097bc0da7944c97702f40f99f22a390a: Status 404 returned error can't find the container with id af358202e679dc4001ac922e1ea9d4b3097bc0da7944c97702f40f99f22a390a Jul 23 15:19:47.763969 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.763955 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 15:19:47.857354 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.857315 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" Jul 23 15:19:47.866548 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.866521 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb748f9f_5323_4cff_946f_c6f7c48aa290.slice/crio-f2af5ab33a3ab6f892dead112b331d2b5086825ba79d182c33ff34edd6a09bfe WatchSource:0}: Error finding container f2af5ab33a3ab6f892dead112b331d2b5086825ba79d182c33ff34edd6a09bfe: Status 404 returned error can't find the container with id f2af5ab33a3ab6f892dead112b331d2b5086825ba79d182c33ff34edd6a09bfe Jul 23 15:19:47.880819 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.880799 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqxch" Jul 23 15:19:47.886777 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.886756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" Jul 23 15:19:47.888306 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.888278 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37a0c87_f595_452a_8820_8d378af36635.slice/crio-9b09016de39b961954fd197554cb4e58b8573381da7f28cd498be4dc3b02385f WatchSource:0}: Error finding container 9b09016de39b961954fd197554cb4e58b8573381da7f28cd498be4dc3b02385f: Status 404 returned error can't find the container with id 9b09016de39b961954fd197554cb4e58b8573381da7f28cd498be4dc3b02385f Jul 23 15:19:47.894383 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.894359 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127a051e_ed78_4bd4_9d27_5279a89cfd1d.slice/crio-6ff3b7fb4920c0f5c9c5f31208e88d2835d63ff8f2ec9cda082787c8ad2e91ea WatchSource:0}: Error finding container 6ff3b7fb4920c0f5c9c5f31208e88d2835d63ff8f2ec9cda082787c8ad2e91ea: Status 404 returned error can't find the container with id 6ff3b7fb4920c0f5c9c5f31208e88d2835d63ff8f2ec9cda082787c8ad2e91ea Jul 23 15:19:47.899451 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.899434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nwmt2" Jul 23 15:19:47.906614 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.906595 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184ad1d7_7c16_42f1_a343_257633bf464e.slice/crio-f37521ad4456c4829ec9e905e7a98d1d95d68e8d349a7448fc48d10c491f5c05 WatchSource:0}: Error finding container f37521ad4456c4829ec9e905e7a98d1d95d68e8d349a7448fc48d10c491f5c05: Status 404 returned error can't find the container with id f37521ad4456c4829ec9e905e7a98d1d95d68e8d349a7448fc48d10c491f5c05 Jul 23 15:19:47.912547 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.912531 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:19:47.915253 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.915235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-68gmr" Jul 23 15:19:47.924288 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.924266 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e66636f_6c89_4bab_9536_cd542ab96d9c.slice/crio-5b2c0610084ff60e3f3dfb04df1dadc91f0529348d01d343f6550955b1e09330 WatchSource:0}: Error finding container 5b2c0610084ff60e3f3dfb04df1dadc91f0529348d01d343f6550955b1e09330: Status 404 returned error can't find the container with id 5b2c0610084ff60e3f3dfb04df1dadc91f0529348d01d343f6550955b1e09330 Jul 23 15:19:47.934364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.934343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ntjrj" Jul 23 15:19:47.941705 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.941679 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a920ee6_145f_415e_b8ec_6a7646245184.slice/crio-8e26ee7a06ae5936dc315ca75b644ebfbe5528be938afdea71c6f6bf4c70fe70 WatchSource:0}: Error finding container 8e26ee7a06ae5936dc315ca75b644ebfbe5528be938afdea71c6f6bf4c70fe70: Status 404 returned error can't find the container with id 8e26ee7a06ae5936dc315ca75b644ebfbe5528be938afdea71c6f6bf4c70fe70 Jul 23 15:19:47.963363 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.963345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:19:47.970303 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:47.970285 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:19:47.970842 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:19:47.970820 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56595aba_438b_4c13_87b1_f258016eab45.slice/crio-90c86f427a402fba5798d3f49932ee55a3314609f753a79b447c96c0db97e866 WatchSource:0}: Error finding container 90c86f427a402fba5798d3f49932ee55a3314609f753a79b447c96c0db97e866: Status 404 returned error can't find the container with id 90c86f427a402fba5798d3f49932ee55a3314609f753a79b447c96c0db97e866 Jul 23 15:19:48.083276 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.083249 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:19:48.144826 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.144750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:48.144977 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.144913 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:48.145035 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.144977 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:19:49.144962779 +0000 UTC m=+2.992616296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:48.246203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.246161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:48.246370 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.246239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:48.246370 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.246353 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:48.246445 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.246408 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:19:49.246395244 +0000 UTC m=+3.094048774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:48.246828 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.246807 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:19:48.246919 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.246835 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:19:48.246919 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.246846 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:48.246919 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:48.246900 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:19:49.246876656 +0000 UTC m=+3.094530174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:48.570485 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.570450 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:19:48.579741 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.579616 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:14:47 +0000 UTC" deadline="2028-03-01 03:19:40.58285997 +0000 UTC" Jul 23 15:19:48.579741 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.579700 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14075h59m52.003163563s" Jul 23 15:19:48.751518 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.751460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"90c86f427a402fba5798d3f49932ee55a3314609f753a79b447c96c0db97e866"} Jul 23 15:19:48.759674 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.759544 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ntjrj" event={"ID":"2a920ee6-145f-415e-b8ec-6a7646245184","Type":"ContainerStarted","Data":"8e26ee7a06ae5936dc315ca75b644ebfbe5528be938afdea71c6f6bf4c70fe70"} Jul 23 15:19:48.764913 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.764879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" event={"ID":"127a051e-ed78-4bd4-9d27-5279a89cfd1d","Type":"ContainerStarted","Data":"6ff3b7fb4920c0f5c9c5f31208e88d2835d63ff8f2ec9cda082787c8ad2e91ea"} Jul 23 15:19:48.771099 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.770954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" event={"ID":"db748f9f-5323-4cff-946f-c6f7c48aa290","Type":"ContainerStarted","Data":"f2af5ab33a3ab6f892dead112b331d2b5086825ba79d182c33ff34edd6a09bfe"} Jul 23 15:19:48.791514 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.791474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" event={"ID":"47481dd6419387374d030821f473aa00","Type":"ContainerStarted","Data":"5d3e96cab1fa8754033bdd97341188f5c4f7f1d09a88ee198d6889138677bfca"} Jul 23 15:19:48.795282 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.795207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-psxwh" event={"ID":"fa45590e-a975-44f6-97ae-1b6698141974","Type":"ContainerStarted","Data":"435ba890e91fdfc6b21c0770c7a686c1cca8ae6d1e113edf24f47a345b60c893"} Jul 23 15:19:48.798769 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.798740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerStarted","Data":"5b2c0610084ff60e3f3dfb04df1dadc91f0529348d01d343f6550955b1e09330"} Jul 23 15:19:48.807673 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.807625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nwmt2" event={"ID":"184ad1d7-7c16-42f1-a343-257633bf464e","Type":"ContainerStarted","Data":"f37521ad4456c4829ec9e905e7a98d1d95d68e8d349a7448fc48d10c491f5c05"} Jul 23 15:19:48.811700 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.811640 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqxch" event={"ID":"b37a0c87-f595-452a-8820-8d378af36635","Type":"ContainerStarted","Data":"9b09016de39b961954fd197554cb4e58b8573381da7f28cd498be4dc3b02385f"} Jul 23 15:19:48.817370 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:48.817336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"8d47012c6139c8962029c67475d5f8a9","Type":"ContainerStarted","Data":"af358202e679dc4001ac922e1ea9d4b3097bc0da7944c97702f40f99f22a390a"} Jul 23 15:19:49.154480 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.154436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:49.154697 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.154581 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:49.154697 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.154672 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:19:51.154637655 +0000 UTC m=+5.002291185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:49.255052 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.255017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:49.255335 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.255098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:49.255335 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.255295 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:19:49.255335 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.255312 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:19:49.255335 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.255325 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:49.255608 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.255377 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:19:51.255360637 +0000 UTC m=+5.103014170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:49.255992 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.255966 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:49.256083 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.256027 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:19:51.256011939 +0000 UTC m=+5.103665472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:49.457896 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.457867 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:19:49.580713 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.580670 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:14:47 +0000 UTC" deadline="2028-03-10 11:21:48.758087132 +0000 UTC" Jul 23 15:19:49.580713 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.580712 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14300h1m59.177379675s" Jul 23 15:19:49.744277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.744208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:49.744467 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.744342 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:19:49.744791 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.744768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:49.744900 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.744878 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:49.744971 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:49.744959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:49.745054 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:49.745033 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:51.172091 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:51.171465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:51.172091 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.171688 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:51.172091 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.171752 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:19:55.17173465 +0000 UTC m=+9.019388190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:51.272089 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:51.272056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:51.272267 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:51.272110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:51.272267 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.272235 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:19:51.272267 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.272253 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:19:51.272267 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.272262 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:51.272478 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.272303 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:19:55.272291215 +0000 UTC m=+9.119944732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:51.272478 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.272356 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:51.272478 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.272378 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:19:55.272371216 +0000 UTC m=+9.120024733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:51.743901 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:51.743871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:51.744100 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.744018 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:51.744430 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:51.744399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:51.744537 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.744499 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:51.744591 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:51.744543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:51.744640 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:51.744610 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:19:53.743595 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:53.743529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:53.744095 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:53.743711 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:53.744095 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:53.743841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:53.744095 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:53.743847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:53.744095 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:53.743950 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:19:53.744095 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:53.744048 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:55.204888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:55.204854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:55.205374 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.205019 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:55.205374 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.205097 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:20:03.205078985 +0000 UTC m=+17.052732523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:55.305581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:55.305631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.305781 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.305843 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:03.30582443 +0000 UTC m=+17.153477947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.305987 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.306008 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.306021 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:55.306166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.306061 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:20:03.306047282 +0000 UTC m=+17.153700816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:19:55.744515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:55.743764 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:55.744515 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.743911 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:19:55.744515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:55.744249 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:55.744515 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.744363 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:55.744515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:55.744411 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:55.744515 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:55.744480 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:57.743912 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:57.743877 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:57.744309 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:57.744017 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:57.744411 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:57.744399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:57.744479 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:57.744460 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:57.744532 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:57.744504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:57.744563 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:57.744544 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:19:59.744235 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:59.744033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:19:59.744757 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:59.744033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:19:59.744757 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:59.744337 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:19:59.744757 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:19:59.744044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:19:59.744757 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:59.744393 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:19:59.744757 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:19:59.744457 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:01.744477 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:01.744441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:01.744477 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:01.744472 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:01.745010 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:01.744445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:01.745010 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:01.744576 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:01.745010 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:01.744633 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:01.745010 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:01.744725 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:03.264866 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:03.264784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:03.265327 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.264940 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:20:03.265327 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.265007 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:20:19.26499228 +0000 UTC m=+33.112645800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:20:03.365906 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:03.365868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:03.366099 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:03.365943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:03.366099 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.366049 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:20:03.366099 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.366062 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:20:03.366099 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.366082 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:20:03.366099 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.366094 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:20:03.366332 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.366136 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:19.366100216 +0000 UTC m=+33.213753753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:20:03.366332 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.366152 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:20:19.366145255 +0000 UTC m=+33.213798773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:20:03.743532 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:03.743499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:03.743792 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:03.743502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:03.743792 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.743601 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:03.743792 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:03.743502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:03.743792 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.743720 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:03.743792 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:03.743765 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:05.744508 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:05.744476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:05.744971 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:05.744476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:05.744971 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:05.744612 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:05.744971 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:05.744479 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:05.744971 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:05.744726 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:05.744971 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:05.744776 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:07.744386 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:07.744362 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:07.744789 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:07.744440 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:07.744789 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:07.744452 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:07.744789 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:07.744363 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:07.744789 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:07.744535 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:07.744789 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:07.744607 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:08.868484 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.868401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.868858 2575 generic.go:356] "Generic (PLEG): container finished" podID="56595aba-438b-4c13-87b1-f258016eab45" containerID="d4863a01645a9ceb2470380b5638bdb7aa32a0654ea824dd4ba2865406b73288" exitCode=1 Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.868943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"6e0b62060f3b696070f070c5811e0d33c96a23cc0053004c9943991e133845e4"} Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.869024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"08c8f25e3ed788997065d78f060e0c85d33e0595c5f0a03c4ddc6df1e87dd267"} Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.869076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"d5111136de20ee17802f5016d0f8d3b506906056370dea9f63366578fd2b9d56"} Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.869123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"b03fb0d7832a44eabb6db40efcedf3ba587db80f98cbdca966b4cc11a8ee4ee2"} Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.869166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerDied","Data":"d4863a01645a9ceb2470380b5638bdb7aa32a0654ea824dd4ba2865406b73288"} Jul 23 15:20:08.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.869233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"416755f89e2dcb7785e5484579213275be85012adf0689496fe3c8d05949c214"} Jul 23 15:20:08.870764 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.870718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ntjrj" event={"ID":"2a920ee6-145f-415e-b8ec-6a7646245184","Type":"ContainerStarted","Data":"1330f4c1ca5d6cd69bcf11dfdeb834c1cf7c5c3bddc5a1c114533267d9572039"} Jul 23 15:20:08.872374 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.872344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" event={"ID":"127a051e-ed78-4bd4-9d27-5279a89cfd1d","Type":"ContainerStarted","Data":"9f7600d622b84813b5f460ba88c8311ac968922f2fac4cffed551a409eabfa99"} Jul 23 15:20:08.874043 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.874016 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" event={"ID":"db748f9f-5323-4cff-946f-c6f7c48aa290","Type":"ContainerStarted","Data":"a23cd4ddf85e2a30b2e27499b638f205991ef6928fa55b4c9ca2829b600e3568"} Jul 23 15:20:08.875429 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.875403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" event={"ID":"47481dd6419387374d030821f473aa00","Type":"ContainerStarted","Data":"6527d7daf75aedccb97536020a1cbe80096cb04b81493da5f892741e42ffd589"} Jul 23 15:20:08.876935 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.876905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-psxwh" event={"ID":"fa45590e-a975-44f6-97ae-1b6698141974","Type":"ContainerStarted","Data":"0a742cbc361f6e1f2acc3105500114b8aaba480ab80080f1f2557d0d5c3545d1"} Jul 23 15:20:08.878557 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.878534 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e66636f-6c89-4bab-9536-cd542ab96d9c" containerID="e637e1030ed65b93aafe001fd592c965ef1697911028bcba1fbd482c844c3457" exitCode=0 Jul 23 15:20:08.878676 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.878577 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerDied","Data":"e637e1030ed65b93aafe001fd592c965ef1697911028bcba1fbd482c844c3457"} Jul 23 15:20:08.880461 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.880434 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nwmt2" event={"ID":"184ad1d7-7c16-42f1-a343-257633bf464e","Type":"ContainerStarted","Data":"e2cd8c4afd997d0dfcb91ffcc68f5a9fdcc2eb89c5bd311e07d329be8d390f58"} Jul 23 15:20:08.882243 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.882214 2575 generic.go:356] "Generic (PLEG): container finished" podID="8d47012c6139c8962029c67475d5f8a9" containerID="81a7401164d6d28f212e650f00985f5e83f646db3353409dda944ba7dff7dba4" exitCode=0 Jul 23 15:20:08.882329 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.882251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"8d47012c6139c8962029c67475d5f8a9","Type":"ContainerDied","Data":"81a7401164d6d28f212e650f00985f5e83f646db3353409dda944ba7dff7dba4"} Jul 23 15:20:08.888079 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.888018 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ntjrj" podStartSLOduration=2.8566498449999997 podStartE2EDuration="22.888001287s" totalImagesPullingTime="20.031351442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:08.887509038 +0000 UTC m=+22.735162577" watchObservedRunningTime="2026-07-23 15:20:08.888001287 +0000 UTC m=+22.735654827" Jul 23 15:20:08.913785 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.913732 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" podStartSLOduration=21.91371349 podStartE2EDuration="21.91371349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:08.913114068 +0000 UTC m=+22.760767608" watchObservedRunningTime="2026-07-23 15:20:08.91371349 +0000 UTC m=+22.761367031" Jul 23 15:20:08.929999 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.929752 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rmmzt" podStartSLOduration=3.107406106 podStartE2EDuration="22.929737108s" totalImagesPullingTime="19.822331002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:08.929299484 +0000 UTC m=+22.776953024" watchObservedRunningTime="2026-07-23 15:20:08.929737108 +0000 UTC m=+22.777390647" Jul 23 15:20:08.947283 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.947231 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nwmt2" podStartSLOduration=3.160880532 podStartE2EDuration="22.947215787s" totalImagesPullingTime="19.786335255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:08.947122872 +0000 UTC m=+22.794776411" watchObservedRunningTime="2026-07-23 15:20:08.947215787 +0000 UTC m=+22.794869326" Jul 23 15:20:08.984432 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:08.984381 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-psxwh" podStartSLOduration=8.117492127 podStartE2EDuration="22.984368208s" totalImagesPullingTime="14.866876081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:08.983955471 +0000 UTC m=+22.831609011" watchObservedRunningTime="2026-07-23 15:20:08.984368208 +0000 UTC m=+22.832021746" Jul 23 15:20:09.723092 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.723067 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 15:20:09.744140 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.744114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:09.744140 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.744137 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:09.744344 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:09.744249 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:09.744344 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:09.744304 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:09.744467 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.744354 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:09.744467 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:09.744405 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:09.886247 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.886166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqxch" event={"ID":"b37a0c87-f595-452a-8820-8d378af36635","Type":"ContainerStarted","Data":"86758024a0ac1e3ede575098a94eba6b2e76c739213485be51e4e1051e8e93fd"} Jul 23 15:20:09.888397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.888366 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"8d47012c6139c8962029c67475d5f8a9","Type":"ContainerStarted","Data":"c464b1e25713e389fa96701c80ea054f892155e8cd2d43c17014c9b5bbf06ff0"} Jul 23 15:20:09.890554 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.890504 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" event={"ID":"db748f9f-5323-4cff-946f-c6f7c48aa290","Type":"ContainerStarted","Data":"c59ac75e5a539cda3a702626fa920d2a2a867e5945fee03e3fdb5dc5d8cd1602"} Jul 23 15:20:09.903751 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.903695 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mqxch" podStartSLOduration=4.076263465 podStartE2EDuration="23.903675666s" totalImagesPullingTime="19.827412201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:09.902911053 +0000 UTC m=+23.750564593" watchObservedRunningTime="2026-07-23 15:20:09.903675666 +0000 UTC m=+23.751329195" Jul 23 15:20:09.918061 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:09.918020 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" podStartSLOduration=22.9180067 podStartE2EDuration="22.9180067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:09.917689544 +0000 UTC m=+23.765343084" watchObservedRunningTime="2026-07-23 15:20:09.9180067 +0000 UTC m=+23.765660239" Jul 23 15:20:10.442723 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.442689 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5w4hz"] Jul 23 15:20:10.446083 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.446060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.449433 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.449408 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 15:20:10.449556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.449446 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 15:20:10.450234 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.450214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h8lrk\"" Jul 23 15:20:10.516047 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.516014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-hosts-file\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.516221 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.516071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-tmp-dir\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.516221 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.516133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzxzt\" (UniqueName: \"kubernetes.io/projected/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-kube-api-access-xzxzt\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.594215 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.594109 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T15:20:09.723086711Z","UUID":"3df49241-b4b4-4d02-861a-33d6744f6513","Handler":null,"Name":"","Endpoint":""} Jul 23 15:20:10.595773 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.595750 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 15:20:10.595899 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.595796 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 15:20:10.616919 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.616887 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-hosts-file\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.617065 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.616924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-tmp-dir\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.617065 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.616985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzxzt\" (UniqueName: \"kubernetes.io/projected/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-kube-api-access-xzxzt\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.617065 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.617007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-hosts-file\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.617391 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.617371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-tmp-dir\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.633311 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.633283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzxzt\" (UniqueName: \"kubernetes.io/projected/1fbeac19-89df-4864-95dc-50fb0d8f3bcf-kube-api-access-xzxzt\") pod \"node-resolver-5w4hz\" (UID: \"1fbeac19-89df-4864-95dc-50fb0d8f3bcf\") " pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.756720 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.756694 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5w4hz" Jul 23 15:20:10.778596 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:10.778565 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbeac19_89df_4864_95dc_50fb0d8f3bcf.slice/crio-27cbbf8e2690cb30cf0e05d981a146661e1131bc97484ff95d36b632ed0fe13f WatchSource:0}: Error finding container 27cbbf8e2690cb30cf0e05d981a146661e1131bc97484ff95d36b632ed0fe13f: Status 404 returned error can't find the container with id 27cbbf8e2690cb30cf0e05d981a146661e1131bc97484ff95d36b632ed0fe13f Jul 23 15:20:10.894957 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.894917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5w4hz" event={"ID":"1fbeac19-89df-4864-95dc-50fb0d8f3bcf","Type":"ContainerStarted","Data":"27cbbf8e2690cb30cf0e05d981a146661e1131bc97484ff95d36b632ed0fe13f"} Jul 23 15:20:10.899140 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.899106 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:20:10.899676 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:10.899565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"db259c24f8d1fb8bdcb6ebab7276871413c6f6086ac0ca4681ca84a537d1f2d4"} Jul 23 15:20:11.744200 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.744167 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:11.744200 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.744195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:11.744200 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.744167 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:11.744598 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:11.744295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:11.744598 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:11.744368 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:11.744598 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:11.744474 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:11.774706 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.774651 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:20:11.775239 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.775217 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:20:11.903996 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.903958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5w4hz" event={"ID":"1fbeac19-89df-4864-95dc-50fb0d8f3bcf","Type":"ContainerStarted","Data":"afadecadf577eeeb68e5017059d3193a1ddfa464d8f8fb8893353027a95f1ab6"} Jul 23 15:20:11.906191 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.906164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" event={"ID":"db748f9f-5323-4cff-946f-c6f7c48aa290","Type":"ContainerStarted","Data":"5cece3056ca5a23f125733af4eba2a5d0e47577409dfa905c5cea890b27390ce"} Jul 23 15:20:11.936486 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.936422 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5w4hz" podStartSLOduration=1.936407529 podStartE2EDuration="1.936407529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:11.919329772 +0000 UTC m=+25.766983311" watchObservedRunningTime="2026-07-23 15:20:11.936407529 +0000 UTC m=+25.784061067" Jul 23 15:20:11.936697 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:11.936577 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s9bgh" podStartSLOduration=3.61803696 podStartE2EDuration="25.936570714s" totalImagesPullingTime="22.318533754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:11.936259127 +0000 UTC m=+25.783912666" watchObservedRunningTime="2026-07-23 15:20:11.936570714 +0000 UTC m=+25.784224253" Jul 23 15:20:13.743843 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.743506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:13.744485 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.743571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:13.744485 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.743602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:13.744485 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:13.744057 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:13.744485 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:13.743920 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:13.744485 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:13.744119 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:13.913554 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.913462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:20:13.913915 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.913885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"2f0c504d4b82ce46c59e60a0992ba3fecf4d1de3e38585e0cadf14a26e2a43f7"} Jul 23 15:20:13.914195 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.914171 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:20:13.914332 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.914315 2575 scope.go:117] "RemoveContainer" containerID="d4863a01645a9ceb2470380b5638bdb7aa32a0654ea824dd4ba2865406b73288" Jul 23 15:20:13.915836 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.915804 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e66636f-6c89-4bab-9536-cd542ab96d9c" containerID="2131458f1122886e909c1ad0ea47594cce80c0cefe71ad9def8272d525464f00" exitCode=0 Jul 23 15:20:13.915922 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.915840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerDied","Data":"2131458f1122886e909c1ad0ea47594cce80c0cefe71ad9def8272d525464f00"} Jul 23 15:20:13.931767 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:13.931741 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:20:14.921982 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:14.921961 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:20:14.922442 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:14.922316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" event={"ID":"56595aba-438b-4c13-87b1-f258016eab45","Type":"ContainerStarted","Data":"c70a36f5be12617a28a2eeceb9e745aa3c7491d0187a09fbfab5343a1afe36ab"} Jul 23 15:20:14.922670 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:14.922628 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:20:14.922785 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:14.922727 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:20:14.938422 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:14.938401 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:20:14.950572 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:14.950515 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" podStartSLOduration=9.164539169 podStartE2EDuration="28.950498076s" totalImagesPullingTime="19.785958907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:14.948988521 +0000 UTC m=+28.796642061" watchObservedRunningTime="2026-07-23 15:20:14.950498076 +0000 UTC m=+28.798151615" Jul 23 15:20:15.445469 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.445428 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6p72c"] Jul 23 15:20:15.445648 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.445579 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:15.445723 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:15.445676 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:15.448421 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.448386 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5j82"] Jul 23 15:20:15.448524 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.448497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:15.448604 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:15.448586 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:15.456318 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.456249 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hf4mp"] Jul 23 15:20:15.456437 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.456352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:15.456488 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:15.456442 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:15.927283 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.927255 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e66636f-6c89-4bab-9536-cd542ab96d9c" containerID="65d7f894db0c384d179b617dec2a84a1ac8c6b90893cc25b4dbd96b7eb715d32" exitCode=0 Jul 23 15:20:15.927632 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:15.927339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerDied","Data":"65d7f894db0c384d179b617dec2a84a1ac8c6b90893cc25b4dbd96b7eb715d32"} Jul 23 15:20:16.746543 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:16.746518 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:16.746745 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:16.746523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:16.746745 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:16.746616 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:16.746745 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:16.746695 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:16.946881 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:16.946849 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:20:16.947258 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:16.946987 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 23 15:20:16.947461 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:16.947441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-psxwh" Jul 23 15:20:17.744077 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:17.743904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:17.744202 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:17.744165 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:17.934887 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:17.934852 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e66636f-6c89-4bab-9536-cd542ab96d9c" containerID="c31e5d4a520e78cf1aec172b4a4a7e0cb3badde0ca7f92be132aed0f5a6f3edc" exitCode=0 Jul 23 15:20:17.935048 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:17.934935 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerDied","Data":"c31e5d4a520e78cf1aec172b4a4a7e0cb3badde0ca7f92be132aed0f5a6f3edc"} Jul 23 15:20:18.747855 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:18.747828 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:18.748430 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:18.747947 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:18.748430 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:18.748266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:18.748430 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:18.748358 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:19.284542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:19.284510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:19.284709 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.284624 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:20:19.284709 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.284693 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret podName:b28492ba-00b6-47c8-93e7-311e6556d0bd nodeName:}" failed. No retries permitted until 2026-07-23 15:20:51.284676135 +0000 UTC m=+65.132329653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret") pod "global-pull-secret-syncer-6p72c" (UID: "b28492ba-00b6-47c8-93e7-311e6556d0bd") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:20:19.385751 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:19.385672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:19.385751 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:19.385726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:19.385966 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.385821 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:20:19.385966 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.385839 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:20:19.385966 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.385867 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:20:19.385966 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.385879 2575 projected.go:196] Error preparing data for projected volume kube-api-access-q2zlf for pod openshift-network-diagnostics/network-check-target-hf4mp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:20:19.385966 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.385885 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs podName:4359259a-6b2e-445c-aee7-db07a6bb35d9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:51.385864749 +0000 UTC m=+65.233518290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs") pod "network-metrics-daemon-l5j82" (UID: "4359259a-6b2e-445c-aee7-db07a6bb35d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:20:19.385966 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.385932 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf podName:100e2e9e-41a8-461c-88fa-4012f2ba4a6f nodeName:}" failed. No retries permitted until 2026-07-23 15:20:51.385915653 +0000 UTC m=+65.233569173 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2zlf" (UniqueName: "kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf") pod "network-check-target-hf4mp" (UID: "100e2e9e-41a8-461c-88fa-4012f2ba4a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:20:19.743965 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:19.743888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:19.744127 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:19.744027 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5j82" podUID="4359259a-6b2e-445c-aee7-db07a6bb35d9" Jul 23 15:20:20.743722 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.743620 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:20.744258 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:20.743770 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf4mp" podUID="100e2e9e-41a8-461c-88fa-4012f2ba4a6f" Jul 23 15:20:20.744258 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.743837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:20.744258 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:20.743957 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6p72c" podUID="b28492ba-00b6-47c8-93e7-311e6556d0bd" Jul 23 15:20:20.906957 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.906922 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeReady" Jul 23 15:20:20.907115 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.907071 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 15:20:20.944344 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.944315 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d9d6db559-mj5c9"] Jul 23 15:20:20.947078 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.947057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:20.949590 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.949565 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ctjt9\"" Jul 23 15:20:20.949760 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.949600 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 15:20:20.949760 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.949752 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 15:20:20.949863 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.949846 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 15:20:20.953500 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.953474 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cwr9s"] Jul 23 15:20:20.955457 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.955436 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:20.957963 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.957933 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 15:20:20.957963 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.957945 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pn9lg\"" Jul 23 15:20:20.958306 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.958284 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 15:20:20.959571 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.959548 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4pnvw"] Jul 23 15:20:20.960523 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.960506 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 15:20:20.961594 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.961570 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:20.963700 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.963678 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d9d6db559-mj5c9"] Jul 23 15:20:20.963814 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.963704 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 15:20:20.963948 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.963930 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 15:20:20.964056 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.964037 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-24c54\"" Jul 23 15:20:20.965062 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.965041 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 15:20:20.971053 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.971033 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4pnvw"] Jul 23 15:20:20.977360 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:20.977334 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cwr9s"] Jul 23 15:20:21.098035 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.097995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-certificates\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098035 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-bound-sa-token\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098254 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxx5\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-kube-api-access-pzxx5\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098254 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-installation-pull-secrets\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098254 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz7wm\" (UniqueName: \"kubernetes.io/projected/a3d85d1d-3282-43c2-a96a-87cef82e05fb-kube-api-access-bz7wm\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.098254 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804f6d55-2dd0-4b8e-8cec-3531362eb251-ca-trust-extracted\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098395 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-trusted-ca\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098395 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-image-registry-private-configuration\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098395 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3d85d1d-3282-43c2-a96a-87cef82e05fb-tmp-dir\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.098395 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.098556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3d85d1d-3282-43c2-a96a-87cef82e05fb-config-volume\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.098556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c166ed8-d71e-4e63-888f-1c7dabe257c2-cert\") pod \"ingress-canary-4pnvw\" (UID: \"4c166ed8-d71e-4e63-888f-1c7dabe257c2\") " pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.098556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxkh7\" (UniqueName: \"kubernetes.io/projected/4c166ed8-d71e-4e63-888f-1c7dabe257c2-kube-api-access-qxkh7\") pod \"ingress-canary-4pnvw\" (UID: \"4c166ed8-d71e-4e63-888f-1c7dabe257c2\") " pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.098556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.098496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.199328 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-certificates\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.199520 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-bound-sa-token\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.199520 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199370 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxx5\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-kube-api-access-pzxx5\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.199697 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-installation-pull-secrets\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.199752 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz7wm\" (UniqueName: \"kubernetes.io/projected/a3d85d1d-3282-43c2-a96a-87cef82e05fb-kube-api-access-bz7wm\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.199991 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-certificates\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.200025 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.199986 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804f6d55-2dd0-4b8e-8cec-3531362eb251-ca-trust-extracted\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.200056 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-trusted-ca\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.200105 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-image-registry-private-configuration\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.200139 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3d85d1d-3282-43c2-a96a-87cef82e05fb-tmp-dir\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.200171 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.200200 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3d85d1d-3282-43c2-a96a-87cef82e05fb-config-volume\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.200229 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c166ed8-d71e-4e63-888f-1c7dabe257c2-cert\") pod \"ingress-canary-4pnvw\" (UID: \"4c166ed8-d71e-4e63-888f-1c7dabe257c2\") " pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.200261 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxkh7\" (UniqueName: \"kubernetes.io/projected/4c166ed8-d71e-4e63-888f-1c7dabe257c2-kube-api-access-qxkh7\") pod \"ingress-canary-4pnvw\" (UID: \"4c166ed8-d71e-4e63-888f-1c7dabe257c2\") " pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.200315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.200315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804f6d55-2dd0-4b8e-8cec-3531362eb251-ca-trust-extracted\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.200558 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.200534 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:20:21.200629 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.200561 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9d6db559-mj5c9: secret "image-registry-tls" not found Jul 23 15:20:21.200629 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.200610 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:20:21.200629 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.200621 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls podName:804f6d55-2dd0-4b8e-8cec-3531362eb251 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:21.700596627 +0000 UTC m=+35.548250161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls") pod "image-registry-6d9d6db559-mj5c9" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251") : secret "image-registry-tls" not found Jul 23 15:20:21.200814 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3d85d1d-3282-43c2-a96a-87cef82e05fb-tmp-dir\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.200814 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.200695 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls podName:a3d85d1d-3282-43c2-a96a-87cef82e05fb nodeName:}" failed. No retries permitted until 2026-07-23 15:20:21.700676579 +0000 UTC m=+35.548330099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls") pod "dns-default-cwr9s" (UID: "a3d85d1d-3282-43c2-a96a-87cef82e05fb") : secret "dns-default-metrics-tls" not found Jul 23 15:20:21.200944 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.200911 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3d85d1d-3282-43c2-a96a-87cef82e05fb-config-volume\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.201231 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.201195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-trusted-ca\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.205000 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.204967 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c166ed8-d71e-4e63-888f-1c7dabe257c2-cert\") pod \"ingress-canary-4pnvw\" (UID: \"4c166ed8-d71e-4e63-888f-1c7dabe257c2\") " pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.205000 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.204970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-image-registry-private-configuration\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.205372 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.205346 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-installation-pull-secrets\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.207955 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.207935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz7wm\" (UniqueName: \"kubernetes.io/projected/a3d85d1d-3282-43c2-a96a-87cef82e05fb-kube-api-access-bz7wm\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.208059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.208021 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxx5\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-kube-api-access-pzxx5\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.208059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.208045 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-bound-sa-token\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.209282 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.209240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxkh7\" (UniqueName: \"kubernetes.io/projected/4c166ed8-d71e-4e63-888f-1c7dabe257c2-kube-api-access-qxkh7\") pod \"ingress-canary-4pnvw\" (UID: \"4c166ed8-d71e-4e63-888f-1c7dabe257c2\") " pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.276867 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.276826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4pnvw" Jul 23 15:20:21.705182 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.704990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:21.705182 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.705054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:21.705182 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.705155 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:20:21.705490 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.705241 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls podName:a3d85d1d-3282-43c2-a96a-87cef82e05fb nodeName:}" failed. No retries permitted until 2026-07-23 15:20:22.705209049 +0000 UTC m=+36.552862589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls") pod "dns-default-cwr9s" (UID: "a3d85d1d-3282-43c2-a96a-87cef82e05fb") : secret "dns-default-metrics-tls" not found Jul 23 15:20:21.705490 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.705158 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:20:21.705490 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.705273 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9d6db559-mj5c9: secret "image-registry-tls" not found Jul 23 15:20:21.705490 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:21.705350 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls podName:804f6d55-2dd0-4b8e-8cec-3531362eb251 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:22.705333595 +0000 UTC m=+36.552987131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls") pod "image-registry-6d9d6db559-mj5c9" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251") : secret "image-registry-tls" not found Jul 23 15:20:21.744424 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.744390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:21.747112 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.747085 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 15:20:21.747242 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:21.747154 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwfsc\"" Jul 23 15:20:22.030953 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.030731 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4pnvw"] Jul 23 15:20:22.033964 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:22.033940 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c166ed8_d71e_4e63_888f_1c7dabe257c2.slice/crio-f1ec9677b53905043ae2dddf3bc539ade99f6a63d45c19b607308617ab218513 WatchSource:0}: Error finding container f1ec9677b53905043ae2dddf3bc539ade99f6a63d45c19b607308617ab218513: Status 404 returned error can't find the container with id f1ec9677b53905043ae2dddf3bc539ade99f6a63d45c19b607308617ab218513 Jul 23 15:20:22.712043 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.712009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:22.712215 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.712057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:22.712215 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:22.712177 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:20:22.712215 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:22.712186 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:20:22.712215 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:22.712207 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9d6db559-mj5c9: secret "image-registry-tls" not found Jul 23 15:20:22.712412 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:22.712230 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls podName:a3d85d1d-3282-43c2-a96a-87cef82e05fb nodeName:}" failed. No retries permitted until 2026-07-23 15:20:24.712217307 +0000 UTC m=+38.559870824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls") pod "dns-default-cwr9s" (UID: "a3d85d1d-3282-43c2-a96a-87cef82e05fb") : secret "dns-default-metrics-tls" not found Jul 23 15:20:22.712412 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:22.712257 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls podName:804f6d55-2dd0-4b8e-8cec-3531362eb251 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:24.71224053 +0000 UTC m=+38.559894048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls") pod "image-registry-6d9d6db559-mj5c9" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251") : secret "image-registry-tls" not found Jul 23 15:20:22.748446 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.748416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:22.748884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.748602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:22.751129 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.751094 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 15:20:22.751246 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.751199 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 15:20:22.752107 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.751937 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9jtq\"" Jul 23 15:20:22.752107 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.751963 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 15:20:22.960614 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.960577 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e66636f-6c89-4bab-9536-cd542ab96d9c" containerID="3425e070053926fecdfb315f9aad89e9cc2b78fce3dd55ddd8c956c2eb528863" exitCode=0 Jul 23 15:20:22.960811 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.960693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerDied","Data":"3425e070053926fecdfb315f9aad89e9cc2b78fce3dd55ddd8c956c2eb528863"} Jul 23 15:20:22.962249 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:22.962190 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4pnvw" event={"ID":"4c166ed8-d71e-4e63-888f-1c7dabe257c2","Type":"ContainerStarted","Data":"f1ec9677b53905043ae2dddf3bc539ade99f6a63d45c19b607308617ab218513"} Jul 23 15:20:23.968890 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:23.968844 2575 generic.go:356] "Generic (PLEG): container finished" podID="1e66636f-6c89-4bab-9536-cd542ab96d9c" containerID="6a50338c696fca93926939b4f09d604603415bcfed02c026d5cf82d79c35bb43" exitCode=0 Jul 23 15:20:23.969427 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:23.968947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerDied","Data":"6a50338c696fca93926939b4f09d604603415bcfed02c026d5cf82d79c35bb43"} Jul 23 15:20:24.726183 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:24.726150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:24.726279 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:24.726193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:24.726338 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:24.726287 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:20:24.726338 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:24.726291 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:20:24.726338 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:24.726306 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9d6db559-mj5c9: secret "image-registry-tls" not found Jul 23 15:20:24.726338 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:24.726337 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls podName:a3d85d1d-3282-43c2-a96a-87cef82e05fb nodeName:}" failed. No retries permitted until 2026-07-23 15:20:28.726322498 +0000 UTC m=+42.573976015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls") pod "dns-default-cwr9s" (UID: "a3d85d1d-3282-43c2-a96a-87cef82e05fb") : secret "dns-default-metrics-tls" not found Jul 23 15:20:24.726474 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:24.726350 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls podName:804f6d55-2dd0-4b8e-8cec-3531362eb251 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:28.726343801 +0000 UTC m=+42.573997317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls") pod "image-registry-6d9d6db559-mj5c9" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251") : secret "image-registry-tls" not found Jul 23 15:20:24.975195 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:24.974931 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68gmr" event={"ID":"1e66636f-6c89-4bab-9536-cd542ab96d9c","Type":"ContainerStarted","Data":"affab1328f990e8849a0e8fe53623be6b9f8992f4f54b4b51525d87ebc056fda"} Jul 23 15:20:24.976720 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:24.976692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4pnvw" event={"ID":"4c166ed8-d71e-4e63-888f-1c7dabe257c2","Type":"ContainerStarted","Data":"b3ba67b2adcf11a0b60e89f1cd31f5efb2006df401638f70a961a7a9158f6534"} Jul 23 15:20:25.000969 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:25.000924 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-68gmr" podStartSLOduration=7.015303314 podStartE2EDuration="39.00090759s" totalImagesPullingTime="31.985604276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:24.998567517 +0000 UTC m=+38.846221091" watchObservedRunningTime="2026-07-23 15:20:25.00090759 +0000 UTC m=+38.848561130" Jul 23 15:20:25.017227 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:25.017174 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4pnvw" podStartSLOduration=2.341989893 podStartE2EDuration="5.017159934s" totalImagesPullingTime="2.675170041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:25.016531563 +0000 UTC m=+38.864185101" watchObservedRunningTime="2026-07-23 15:20:25.017159934 +0000 UTC m=+38.864813472" Jul 23 15:20:27.334186 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.334144 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lzq7n"] Jul 23 15:20:27.363836 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.363801 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lzq7n"] Jul 23 15:20:27.363995 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.363903 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.366300 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.366271 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 15:20:27.366523 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.366491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7xc5v\"" Jul 23 15:20:27.366523 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.366508 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 15:20:27.366523 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.366515 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 15:20:27.366736 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.366557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 15:20:27.447179 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.447139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.447179 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.447188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-data-volume\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.447396 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.447245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.447396 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.447273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-crio-socket\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.447396 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.447288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4sj\" (UniqueName: \"kubernetes.io/projected/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-api-access-mz4sj\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.547950 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.547912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.547950 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.547953 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-data-volume\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.548166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.547994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.548166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.548022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-crio-socket\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.548166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.548038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4sj\" (UniqueName: \"kubernetes.io/projected/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-api-access-mz4sj\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.548166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:27.548062 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:20:27.548166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:27.548123 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:20:27.548166 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:27.548132 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:28.04811202 +0000 UTC m=+41.895765537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : secret "insights-runtime-extractor-tls" not found Jul 23 15:20:27.548449 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:27.548178 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:28.048160973 +0000 UTC m=+41.895814509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : configmap "kube-rbac-proxy" not found Jul 23 15:20:27.548449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.548267 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-crio-socket\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.548449 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.548326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-data-volume\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:27.558143 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:27.558115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4sj\" (UniqueName: \"kubernetes.io/projected/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-api-access-mz4sj\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:28.052082 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:28.052049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:28.052260 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:28.052101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:28.052260 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.052192 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:20:28.052260 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.052194 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:20:28.052260 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.052253 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:29.05223951 +0000 UTC m=+42.899893027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : configmap "kube-rbac-proxy" not found Jul 23 15:20:28.052387 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.052266 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:29.052260306 +0000 UTC m=+42.899913823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : secret "insights-runtime-extractor-tls" not found Jul 23 15:20:28.758077 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:28.758044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:28.758077 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:28.758083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:28.758479 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.758197 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:20:28.758479 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.758197 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:20:28.758479 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.758218 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9d6db559-mj5c9: secret "image-registry-tls" not found Jul 23 15:20:28.758479 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.758248 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls podName:a3d85d1d-3282-43c2-a96a-87cef82e05fb nodeName:}" failed. No retries permitted until 2026-07-23 15:20:36.758235418 +0000 UTC m=+50.605888934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls") pod "dns-default-cwr9s" (UID: "a3d85d1d-3282-43c2-a96a-87cef82e05fb") : secret "dns-default-metrics-tls" not found Jul 23 15:20:28.758479 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:28.758269 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls podName:804f6d55-2dd0-4b8e-8cec-3531362eb251 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:36.758254364 +0000 UTC m=+50.605907881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls") pod "image-registry-6d9d6db559-mj5c9" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251") : secret "image-registry-tls" not found Jul 23 15:20:29.060563 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:29.060485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:29.060563 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:29.060533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:29.060787 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:29.060594 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:20:29.060787 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:29.060626 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:20:29.060787 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:29.060640 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:31.060627563 +0000 UTC m=+44.908281080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : configmap "kube-rbac-proxy" not found Jul 23 15:20:29.060787 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:29.060710 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:31.060696093 +0000 UTC m=+44.908349610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : secret "insights-runtime-extractor-tls" not found Jul 23 15:20:29.309868 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:29.309839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5w4hz_1fbeac19-89df-4864-95dc-50fb0d8f3bcf/dns-node-resolver/0.log" Jul 23 15:20:30.309721 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:30.309696 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nwmt2_184ad1d7-7c16-42f1-a343-257633bf464e/node-ca/0.log" Jul 23 15:20:30.909767 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:30.909734 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4pnvw_4c166ed8-d71e-4e63-888f-1c7dabe257c2/serve-healthcheck-canary/0.log" Jul 23 15:20:31.076830 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:31.076788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:31.076996 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:31.076841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:31.076996 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:31.076914 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:20:31.076996 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:31.076941 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:20:31.076996 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:31.076966 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:35.076953961 +0000 UTC m=+48.924607478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : configmap "kube-rbac-proxy" not found Jul 23 15:20:31.076996 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:31.076992 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:35.076979651 +0000 UTC m=+48.924633171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : secret "insights-runtime-extractor-tls" not found Jul 23 15:20:35.107203 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:35.107169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:35.107577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:35.107224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:35.107577 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:35.107324 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:20:35.107577 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:35.107348 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:20:35.107577 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:35.107388 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:43.107371471 +0000 UTC m=+56.955024987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : secret "insights-runtime-extractor-tls" not found Jul 23 15:20:35.107577 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:35.107401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:43.10739556 +0000 UTC m=+56.955049076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : configmap "kube-rbac-proxy" not found Jul 23 15:20:36.821734 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:36.821694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:36.821734 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:36.821738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:36.822136 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:36.821834 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:20:36.822136 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:36.821845 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:20:36.822136 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:36.821869 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9d6db559-mj5c9: secret "image-registry-tls" not found Jul 23 15:20:36.822136 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:36.821884 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls podName:a3d85d1d-3282-43c2-a96a-87cef82e05fb nodeName:}" failed. No retries permitted until 2026-07-23 15:20:52.821873152 +0000 UTC m=+66.669526668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls") pod "dns-default-cwr9s" (UID: "a3d85d1d-3282-43c2-a96a-87cef82e05fb") : secret "dns-default-metrics-tls" not found Jul 23 15:20:36.822136 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:36.821925 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls podName:804f6d55-2dd0-4b8e-8cec-3531362eb251 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:52.821911195 +0000 UTC m=+66.669564715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls") pod "image-registry-6d9d6db559-mj5c9" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251") : secret "image-registry-tls" not found Jul 23 15:20:43.174100 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:43.174049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:43.174629 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:43.174117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:43.174629 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:43.174233 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:20:43.174629 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:20:43.174318 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls podName:e2f6e626-b322-49aa-9be6-1a4b72e1a6a9 nodeName:}" failed. No retries permitted until 2026-07-23 15:20:59.174296569 +0000 UTC m=+73.021950090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lzq7n" (UID: "e2f6e626-b322-49aa-9be6-1a4b72e1a6a9") : secret "insights-runtime-extractor-tls" not found Jul 23 15:20:43.174629 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:43.174613 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:46.946118 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:46.946091 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxn8b" Jul 23 15:20:51.336102 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.336060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:51.342744 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.342720 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 15:20:51.348600 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.348575 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b28492ba-00b6-47c8-93e7-311e6556d0bd-original-pull-secret\") pod \"global-pull-secret-syncer-6p72c\" (UID: \"b28492ba-00b6-47c8-93e7-311e6556d0bd\") " pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:51.436598 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.436560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:51.436763 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.436609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:51.439566 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.439548 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 15:20:51.439638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.439618 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 15:20:51.450175 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.450153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4359259a-6b2e-445c-aee7-db07a6bb35d9-metrics-certs\") pod \"network-metrics-daemon-l5j82\" (UID: \"4359259a-6b2e-445c-aee7-db07a6bb35d9\") " pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:51.451199 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.451182 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 15:20:51.456952 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.456935 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwfsc\"" Jul 23 15:20:51.460309 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.460291 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2zlf\" (UniqueName: \"kubernetes.io/projected/100e2e9e-41a8-461c-88fa-4012f2ba4a6f-kube-api-access-q2zlf\") pod \"network-check-target-hf4mp\" (UID: \"100e2e9e-41a8-461c-88fa-4012f2ba4a6f\") " pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:51.465078 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.465060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5j82" Jul 23 15:20:51.560291 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.560256 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6p72c" Jul 23 15:20:51.570104 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.570081 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9jtq\"" Jul 23 15:20:51.577455 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.577423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:51.596932 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.596853 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5j82"] Jul 23 15:20:51.601706 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:51.601678 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4359259a_6b2e_445c_aee7_db07a6bb35d9.slice/crio-55fdb7f6386bf855ce0bc5bdec9cf4af669ce43956cce9d8f0dfdc79a2b765a6 WatchSource:0}: Error finding container 55fdb7f6386bf855ce0bc5bdec9cf4af669ce43956cce9d8f0dfdc79a2b765a6: Status 404 returned error can't find the container with id 55fdb7f6386bf855ce0bc5bdec9cf4af669ce43956cce9d8f0dfdc79a2b765a6 Jul 23 15:20:51.694577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.694546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6p72c"] Jul 23 15:20:51.697388 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:51.697363 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28492ba_00b6_47c8_93e7_311e6556d0bd.slice/crio-051df2fad2e918b9a5981d49c28cd8fde649b01fd40d98207551efde0cab2704 WatchSource:0}: Error finding container 051df2fad2e918b9a5981d49c28cd8fde649b01fd40d98207551efde0cab2704: Status 404 returned error can't find the container with id 051df2fad2e918b9a5981d49c28cd8fde649b01fd40d98207551efde0cab2704 Jul 23 15:20:51.710063 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:51.710042 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hf4mp"] Jul 23 15:20:51.712544 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:51.712520 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100e2e9e_41a8_461c_88fa_4012f2ba4a6f.slice/crio-ed15ae6f85c38479ff64cec269cb7d1b8c22b94b998a2e478c577249643ebd71 WatchSource:0}: Error finding container ed15ae6f85c38479ff64cec269cb7d1b8c22b94b998a2e478c577249643ebd71: Status 404 returned error can't find the container with id ed15ae6f85c38479ff64cec269cb7d1b8c22b94b998a2e478c577249643ebd71 Jul 23 15:20:52.048141 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.048061 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hf4mp" event={"ID":"100e2e9e-41a8-461c-88fa-4012f2ba4a6f","Type":"ContainerStarted","Data":"ed15ae6f85c38479ff64cec269cb7d1b8c22b94b998a2e478c577249643ebd71"} Jul 23 15:20:52.049436 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.049406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5j82" event={"ID":"4359259a-6b2e-445c-aee7-db07a6bb35d9","Type":"ContainerStarted","Data":"55fdb7f6386bf855ce0bc5bdec9cf4af669ce43956cce9d8f0dfdc79a2b765a6"} Jul 23 15:20:52.050522 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.050494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6p72c" event={"ID":"b28492ba-00b6-47c8-93e7-311e6556d0bd","Type":"ContainerStarted","Data":"051df2fad2e918b9a5981d49c28cd8fde649b01fd40d98207551efde0cab2704"} Jul 23 15:20:52.849064 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.849036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:52.849515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.849087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:52.851642 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.851566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3d85d1d-3282-43c2-a96a-87cef82e05fb-metrics-tls\") pod \"dns-default-cwr9s\" (UID: \"a3d85d1d-3282-43c2-a96a-87cef82e05fb\") " pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:52.852223 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:52.852009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"image-registry-6d9d6db559-mj5c9\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:53.057088 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.057001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5j82" event={"ID":"4359259a-6b2e-445c-aee7-db07a6bb35d9","Type":"ContainerStarted","Data":"e4a8673a5b7d877f80cb9b1831604b41ff50562210883c3ea7dedda4a6cbf922"} Jul 23 15:20:53.057088 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.057082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5j82" event={"ID":"4359259a-6b2e-445c-aee7-db07a6bb35d9","Type":"ContainerStarted","Data":"b6d7b753dcfd5b3725c312216d36e95bb227d690f883e94fd9ca58df173a13e8"} Jul 23 15:20:53.063439 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.063411 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ctjt9\"" Jul 23 15:20:53.071529 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.071503 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:53.072945 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.072697 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pn9lg\"" Jul 23 15:20:53.075081 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.075030 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l5j82" podStartSLOduration=65.994924102 podStartE2EDuration="1m7.075015346s" totalImagesPullingTime="1.080091244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:53.074035507 +0000 UTC m=+66.921689046" watchObservedRunningTime="2026-07-23 15:20:53.075015346 +0000 UTC m=+66.922668884" Jul 23 15:20:53.080845 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.080774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:53.261607 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.261478 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d9d6db559-mj5c9"] Jul 23 15:20:53.265305 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:53.264379 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804f6d55_2dd0_4b8e_8cec_3531362eb251.slice/crio-990d019c07013820bc44a82796ce72a44d30fb764f4bf3c5c30bfc58f82177b5 WatchSource:0}: Error finding container 990d019c07013820bc44a82796ce72a44d30fb764f4bf3c5c30bfc58f82177b5: Status 404 returned error can't find the container with id 990d019c07013820bc44a82796ce72a44d30fb764f4bf3c5c30bfc58f82177b5 Jul 23 15:20:53.271597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:53.271572 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cwr9s"] Jul 23 15:20:53.276008 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:53.275982 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d85d1d_3282_43c2_a96a_87cef82e05fb.slice/crio-a156e7768312f2451aa2016854f195d32e4584ba6436147ad1b25666d1333cb2 WatchSource:0}: Error finding container a156e7768312f2451aa2016854f195d32e4584ba6436147ad1b25666d1333cb2: Status 404 returned error can't find the container with id a156e7768312f2451aa2016854f195d32e4584ba6436147ad1b25666d1333cb2 Jul 23 15:20:54.063122 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.063059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwr9s" event={"ID":"a3d85d1d-3282-43c2-a96a-87cef82e05fb","Type":"ContainerStarted","Data":"a156e7768312f2451aa2016854f195d32e4584ba6436147ad1b25666d1333cb2"} Jul 23 15:20:54.065908 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.065873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" event={"ID":"804f6d55-2dd0-4b8e-8cec-3531362eb251","Type":"ContainerStarted","Data":"4c2d5c17a88e44a6165a12f05fd6a99663dc956b97c22066e866722d28daff42"} Jul 23 15:20:54.066046 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.065936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" event={"ID":"804f6d55-2dd0-4b8e-8cec-3531362eb251","Type":"ContainerStarted","Data":"990d019c07013820bc44a82796ce72a44d30fb764f4bf3c5c30bfc58f82177b5"} Jul 23 15:20:54.066046 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.066005 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:20:54.087717 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.087637 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" podStartSLOduration=64.087617009 podStartE2EDuration="1m4.087617009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:54.086601624 +0000 UTC m=+67.934255160" watchObservedRunningTime="2026-07-23 15:20:54.087617009 +0000 UTC m=+67.935270546" Jul 23 15:20:54.586317 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.586283 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d9d6db559-mj5c9"] Jul 23 15:20:54.666091 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.666064 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66f99d5d7f-9rbm7"] Jul 23 15:20:54.693576 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.693546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f99d5d7f-9rbm7"] Jul 23 15:20:54.693736 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.693683 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766013 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.765976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-bound-sa-token\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e7c335-cfe2-4a27-84ef-375626788078-ca-trust-extracted\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvlx\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-kube-api-access-4fvlx\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e7c335-cfe2-4a27-84ef-375626788078-trusted-ca\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e7c335-cfe2-4a27-84ef-375626788078-installation-pull-secrets\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e7c335-cfe2-4a27-84ef-375626788078-registry-certificates\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-registry-tls\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.766251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.766242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e7c335-cfe2-4a27-84ef-375626788078-image-registry-private-configuration\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.866787 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e7c335-cfe2-4a27-84ef-375626788078-ca-trust-extracted\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.866787 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvlx\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-kube-api-access-4fvlx\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.866787 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e7c335-cfe2-4a27-84ef-375626788078-trusted-ca\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.866787 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e7c335-cfe2-4a27-84ef-375626788078-installation-pull-secrets\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.867095 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e7c335-cfe2-4a27-84ef-375626788078-registry-certificates\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.867095 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-registry-tls\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.867095 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e7c335-cfe2-4a27-84ef-375626788078-image-registry-private-configuration\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.867095 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.866882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-bound-sa-token\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.867290 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.867142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e7c335-cfe2-4a27-84ef-375626788078-ca-trust-extracted\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.867937 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.867885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e7c335-cfe2-4a27-84ef-375626788078-registry-certificates\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.868442 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.868396 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e7c335-cfe2-4a27-84ef-375626788078-trusted-ca\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.870194 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.870172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-registry-tls\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.870316 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.870262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e7c335-cfe2-4a27-84ef-375626788078-installation-pull-secrets\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.870713 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.870694 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e7c335-cfe2-4a27-84ef-375626788078-image-registry-private-configuration\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.879590 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.879567 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-bound-sa-token\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:54.879903 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:54.879879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvlx\" (UniqueName: \"kubernetes.io/projected/c1e7c335-cfe2-4a27-84ef-375626788078-kube-api-access-4fvlx\") pod \"image-registry-66f99d5d7f-9rbm7\" (UID: \"c1e7c335-cfe2-4a27-84ef-375626788078\") " pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:55.004120 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:55.004035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:57.729385 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:57.729182 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f99d5d7f-9rbm7"] Jul 23 15:20:57.733728 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:57.733692 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e7c335_cfe2_4a27_84ef_375626788078.slice/crio-4a75906f0b715df4794f080f3701d023979a8c5936da6a65a257648f4ebf1e17 WatchSource:0}: Error finding container 4a75906f0b715df4794f080f3701d023979a8c5936da6a65a257648f4ebf1e17: Status 404 returned error can't find the container with id 4a75906f0b715df4794f080f3701d023979a8c5936da6a65a257648f4ebf1e17 Jul 23 15:20:58.080323 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.080289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hf4mp" event={"ID":"100e2e9e-41a8-461c-88fa-4012f2ba4a6f","Type":"ContainerStarted","Data":"bdd82a9ebb8b544ac12b2017cfb919f08893d8d0f035cd6427cb64aa730956f2"} Jul 23 15:20:58.080532 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.080422 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:20:58.081996 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.081957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" event={"ID":"c1e7c335-cfe2-4a27-84ef-375626788078","Type":"ContainerStarted","Data":"3d5f21d8dd83f846951c35987f2ae808fe365175e0cf9cd4a0b08babb70e7da5"} Jul 23 15:20:58.082134 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.082005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" event={"ID":"c1e7c335-cfe2-4a27-84ef-375626788078","Type":"ContainerStarted","Data":"4a75906f0b715df4794f080f3701d023979a8c5936da6a65a257648f4ebf1e17"} Jul 23 15:20:58.082134 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.082030 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:20:58.083519 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.083489 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6p72c" event={"ID":"b28492ba-00b6-47c8-93e7-311e6556d0bd","Type":"ContainerStarted","Data":"7307c894e802448186e220767df4088d13dd8132501cb823ae2b46d86bff787d"} Jul 23 15:20:58.085267 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.085241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwr9s" event={"ID":"a3d85d1d-3282-43c2-a96a-87cef82e05fb","Type":"ContainerStarted","Data":"03612f49fc1142eda2718e0bad5cc8947f942483021a7a84dcfddc10e7c25400"} Jul 23 15:20:58.085396 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.085291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwr9s" event={"ID":"a3d85d1d-3282-43c2-a96a-87cef82e05fb","Type":"ContainerStarted","Data":"0970827301b30bc1d0df6bc6f7d1e01713b1792cc2414c6ab40c90b92ecabbea"} Jul 23 15:20:58.085396 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.085328 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cwr9s" Jul 23 15:20:58.097313 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.097261 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hf4mp" podStartSLOduration=66.241528808 podStartE2EDuration="1m12.097236633s" totalImagesPullingTime="5.855707825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:58.096045179 +0000 UTC m=+71.943698716" watchObservedRunningTime="2026-07-23 15:20:58.097236633 +0000 UTC m=+71.944890172" Jul 23 15:20:58.116689 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.116608 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" podStartSLOduration=4.116586852 podStartE2EDuration="4.116586852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:58.11617466 +0000 UTC m=+71.963828201" watchObservedRunningTime="2026-07-23 15:20:58.116586852 +0000 UTC m=+71.964240393" Jul 23 15:20:58.135752 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.135700 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cwr9s" podStartSLOduration=33.836388784 podStartE2EDuration="38.135683263s" totalImagesPullingTime="4.299294479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:58.135433138 +0000 UTC m=+71.983086689" watchObservedRunningTime="2026-07-23 15:20:58.135683263 +0000 UTC m=+71.983336802" Jul 23 15:20:58.152808 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:58.152746 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6p72c" podStartSLOduration=66.273546267 podStartE2EDuration="1m12.152721158s" totalImagesPullingTime="5.879174891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:58.151509195 +0000 UTC m=+71.999162735" watchObservedRunningTime="2026-07-23 15:20:58.152721158 +0000 UTC m=+72.000374698" Jul 23 15:20:59.199437 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:59.199390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:59.202304 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:59.202269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2f6e626-b322-49aa-9be6-1a4b72e1a6a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzq7n\" (UID: \"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9\") " pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:59.475568 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:59.475488 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7xc5v\"" Jul 23 15:20:59.483692 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:59.483671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lzq7n" Jul 23 15:20:59.619914 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:20:59.619872 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lzq7n"] Jul 23 15:20:59.623481 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:20:59.623453 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f6e626_b322_49aa_9be6_1a4b72e1a6a9.slice/crio-70c40a27d9193efb4c18564444aad4d3b51b58d073503499d917bc1b50d00c19 WatchSource:0}: Error finding container 70c40a27d9193efb4c18564444aad4d3b51b58d073503499d917bc1b50d00c19: Status 404 returned error can't find the container with id 70c40a27d9193efb4c18564444aad4d3b51b58d073503499d917bc1b50d00c19 Jul 23 15:21:00.095769 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:00.095730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzq7n" event={"ID":"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9","Type":"ContainerStarted","Data":"70c40a27d9193efb4c18564444aad4d3b51b58d073503499d917bc1b50d00c19"} Jul 23 15:21:05.116059 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:05.116017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzq7n" event={"ID":"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9","Type":"ContainerStarted","Data":"34b38f7caf18b50e59b6308e9d7f3c4e5173377bb000ecfe771fc9345a903c4f"} Jul 23 15:21:06.314939 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.314902 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt"] Jul 23 15:21:06.324537 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.324078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.328408 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.328379 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 15:21:06.328534 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.328390 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xtn72\"" Jul 23 15:21:06.328534 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.328511 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 15:21:06.328701 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.328684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 15:21:06.329117 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.328975 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 15:21:06.329117 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.328979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 15:21:06.332128 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.332101 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rqcx8"] Jul 23 15:21:06.335390 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.335358 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt"] Jul 23 15:21:06.335513 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.335492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.338425 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.338390 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 15:21:06.338546 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.338397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wbpnh\"" Jul 23 15:21:06.338787 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.338764 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 15:21:06.339057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.339040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 15:21:06.345492 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.345468 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b9pg8"] Jul 23 15:21:06.349392 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.349369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.350358 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.350334 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rqcx8"] Jul 23 15:21:06.353178 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.353161 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 15:21:06.353463 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.353437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 15:21:06.353617 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.353604 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 15:21:06.353952 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.353932 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8qghm\"" Jul 23 15:21:06.454892 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.454837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.455057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.454922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/83d87f52-2895-4143-b871-f41f3fee17c0-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.455057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.454946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-root\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.454970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtg2\" (UniqueName: \"kubernetes.io/projected/3d611547-f182-4600-ae88-436b50ed0dc7-kube-api-access-hbtg2\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d14b7d71-f269-4a91-ad62-051c422dec54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.455057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-wtmp\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14b7d71-f269-4a91-ad62-051c422dec54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-textfile\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d611547-f182-4600-ae88-436b50ed0dc7-metrics-client-ca\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-tls\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d14b7d71-f269-4a91-ad62-051c422dec54-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.455268 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjffb\" (UniqueName: \"kubernetes.io/projected/83d87f52-2895-4143-b871-f41f3fee17c0-kube-api-access-fjffb\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.455577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-sys\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.455577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.455577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455459 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8qm\" (UniqueName: \"kubernetes.io/projected/d14b7d71-f269-4a91-ad62-051c422dec54-kube-api-access-kd8qm\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.455577 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.455491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d87f52-2895-4143-b871-f41f3fee17c0-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556037 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.555897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/83d87f52-2895-4143-b871-f41f3fee17c0-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556037 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.555943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-root\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556037 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.555970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtg2\" (UniqueName: \"kubernetes.io/projected/3d611547-f182-4600-ae88-436b50ed0dc7-kube-api-access-hbtg2\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556037 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.555999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d14b7d71-f269-4a91-ad62-051c422dec54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.556037 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-wtmp\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556307 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14b7d71-f269-4a91-ad62-051c422dec54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.556307 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556064 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-root\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556392 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/83d87f52-2895-4143-b871-f41f3fee17c0-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556392 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-textfile\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556392 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-textfile\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556392 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d611547-f182-4600-ae88-436b50ed0dc7-metrics-client-ca\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-tls\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d14b7d71-f269-4a91-ad62-051c422dec54-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556502 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-wtmp\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjffb\" (UniqueName: \"kubernetes.io/projected/83d87f52-2895-4143-b871-f41f3fee17c0-kube-api-access-fjffb\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-sys\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.556936 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556936 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8qm\" (UniqueName: \"kubernetes.io/projected/d14b7d71-f269-4a91-ad62-051c422dec54-kube-api-access-kd8qm\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.556936 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d87f52-2895-4143-b871-f41f3fee17c0-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.556936 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.556744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.557241 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.557529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.557845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d611547-f182-4600-ae88-436b50ed0dc7-sys\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.557924 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d14b7d71-f269-4a91-ad62-051c422dec54-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:21:06.558020 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.558026 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d611547-f182-4600-ae88-436b50ed0dc7-metrics-client-ca\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.558212 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:21:06.558084 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls podName:83d87f52-2895-4143-b871-f41f3fee17c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:21:07.058066649 +0000 UTC m=+80.905720182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-rqcx8" (UID: "83d87f52-2895-4143-b871-f41f3fee17c0") : secret "kube-state-metrics-tls" not found Jul 23 15:21:06.558671 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.558563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d87f52-2895-4143-b871-f41f3fee17c0-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.559647 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.559555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d14b7d71-f269-4a91-ad62-051c422dec54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.559647 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.559610 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14b7d71-f269-4a91-ad62-051c422dec54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.559998 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.559974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.560160 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.560133 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.561976 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.561953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d611547-f182-4600-ae88-436b50ed0dc7-node-exporter-tls\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.565587 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.565524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjffb\" (UniqueName: \"kubernetes.io/projected/83d87f52-2895-4143-b871-f41f3fee17c0-kube-api-access-fjffb\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:06.565942 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.565918 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtg2\" (UniqueName: \"kubernetes.io/projected/3d611547-f182-4600-ae88-436b50ed0dc7-kube-api-access-hbtg2\") pod \"node-exporter-b9pg8\" (UID: \"3d611547-f182-4600-ae88-436b50ed0dc7\") " pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:06.567008 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.566981 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8qm\" (UniqueName: \"kubernetes.io/projected/d14b7d71-f269-4a91-ad62-051c422dec54-kube-api-access-kd8qm\") pod \"openshift-state-metrics-79f6958cdf-6n9dt\" (UID: \"d14b7d71-f269-4a91-ad62-051c422dec54\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.637563 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.637530 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" Jul 23 15:21:06.660639 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:06.660611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9pg8" Jul 23 15:21:07.061316 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:07.061263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:07.061495 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:21:07.061452 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 15:21:07.061546 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:21:07.061521 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls podName:83d87f52-2895-4143-b871-f41f3fee17c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:21:08.06150564 +0000 UTC m=+81.909159159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-rqcx8" (UID: "83d87f52-2895-4143-b871-f41f3fee17c0") : secret "kube-state-metrics-tls" not found Jul 23 15:21:07.635295 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:21:07.635257 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d611547_f182_4600_ae88_436b50ed0dc7.slice/crio-e34538d8d306fcef778e91756f32f020cf6a05487092c1222e84740f10f718d8 WatchSource:0}: Error finding container e34538d8d306fcef778e91756f32f020cf6a05487092c1222e84740f10f718d8: Status 404 returned error can't find the container with id e34538d8d306fcef778e91756f32f020cf6a05487092c1222e84740f10f718d8 Jul 23 15:21:07.768937 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:07.768908 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt"] Jul 23 15:21:07.771571 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:21:07.771548 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14b7d71_f269_4a91_ad62_051c422dec54.slice/crio-51e392031bd1e50d4d0963ffdcd95b5e1029107252f2897e9c55f7fa23930df6 WatchSource:0}: Error finding container 51e392031bd1e50d4d0963ffdcd95b5e1029107252f2897e9c55f7fa23930df6: Status 404 returned error can't find the container with id 51e392031bd1e50d4d0963ffdcd95b5e1029107252f2897e9c55f7fa23930df6 Jul 23 15:21:08.070534 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.070498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:08.072905 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.072885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83d87f52-2895-4143-b871-f41f3fee17c0-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-rqcx8\" (UID: \"83d87f52-2895-4143-b871-f41f3fee17c0\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:08.090866 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.090845 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cwr9s" Jul 23 15:21:08.128611 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.128570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pg8" event={"ID":"3d611547-f182-4600-ae88-436b50ed0dc7","Type":"ContainerStarted","Data":"e34538d8d306fcef778e91756f32f020cf6a05487092c1222e84740f10f718d8"} Jul 23 15:21:08.130793 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.130712 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzq7n" event={"ID":"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9","Type":"ContainerStarted","Data":"3da8e3dea07c4214b35dcb3a5ec236b25742d59815cf131654f2ad2a23e9f5f6"} Jul 23 15:21:08.137649 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.137577 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" event={"ID":"d14b7d71-f269-4a91-ad62-051c422dec54","Type":"ContainerStarted","Data":"31eafa371e57f3be9cba89f91c6f99f0ea8344a2375947ac1b49badca17d067f"} Jul 23 15:21:08.137814 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.137646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" event={"ID":"d14b7d71-f269-4a91-ad62-051c422dec54","Type":"ContainerStarted","Data":"d51a97bf5f8ec8b9118c63135c31c1ab2d90c7a8816ffb8110effce874005ef2"} Jul 23 15:21:08.137814 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.137700 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" event={"ID":"d14b7d71-f269-4a91-ad62-051c422dec54","Type":"ContainerStarted","Data":"51e392031bd1e50d4d0963ffdcd95b5e1029107252f2897e9c55f7fa23930df6"} Jul 23 15:21:08.146799 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.146771 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" Jul 23 15:21:08.299189 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:08.299151 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-rqcx8"] Jul 23 15:21:08.302510 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:21:08.302475 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d87f52_2895_4143_b871_f41f3fee17c0.slice/crio-c4159e18e364f4c5d76a236f79c0e6fd7d350c799fc27ea141f0f0c904574ec4 WatchSource:0}: Error finding container c4159e18e364f4c5d76a236f79c0e6fd7d350c799fc27ea141f0f0c904574ec4: Status 404 returned error can't find the container with id c4159e18e364f4c5d76a236f79c0e6fd7d350c799fc27ea141f0f0c904574ec4 Jul 23 15:21:09.144601 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.144527 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" event={"ID":"83d87f52-2895-4143-b871-f41f3fee17c0","Type":"ContainerStarted","Data":"c4159e18e364f4c5d76a236f79c0e6fd7d350c799fc27ea141f0f0c904574ec4"} Jul 23 15:21:09.147424 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.146826 2575 generic.go:356] "Generic (PLEG): container finished" podID="3d611547-f182-4600-ae88-436b50ed0dc7" containerID="f0b68226aa4c9fff26bda7c3001738e42334ab5045bbadb47f5592e0b34f2fac" exitCode=0 Jul 23 15:21:09.147424 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.146880 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pg8" event={"ID":"3d611547-f182-4600-ae88-436b50ed0dc7","Type":"ContainerDied","Data":"f0b68226aa4c9fff26bda7c3001738e42334ab5045bbadb47f5592e0b34f2fac"} Jul 23 15:21:09.282878 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.282849 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-bd68f9587-g68g7"] Jul 23 15:21:09.285714 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.285682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.289896 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.289872 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 15:21:09.290202 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.290182 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 15:21:09.290397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.290378 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f3kgdirq86is3\"" Jul 23 15:21:09.290547 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.290533 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 15:21:09.290733 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.290716 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mns4h\"" Jul 23 15:21:09.291023 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.291003 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 15:21:09.291230 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.291210 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 15:21:09.302338 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.302313 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bd68f9587-g68g7"] Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-tls\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00396778-bb09-43f5-8829-72052aab3e12-metrics-client-ca\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln6wj\" (UniqueName: \"kubernetes.io/projected/00396778-bb09-43f5-8829-72052aab3e12-kube-api-access-ln6wj\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380716 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-grpc-tls\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.380888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.380767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.481899 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.481857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.481931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.481960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00396778-bb09-43f5-8829-72052aab3e12-metrics-client-ca\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482031 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.481997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln6wj\" (UniqueName: \"kubernetes.io/projected/00396778-bb09-43f5-8829-72052aab3e12-kube-api-access-ln6wj\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482130 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.482028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482130 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.482082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-grpc-tls\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482554 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.482397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482554 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.482469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-tls\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.482769 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.482752 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00396778-bb09-43f5-8829-72052aab3e12-metrics-client-ca\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.486371 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.486312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.486978 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.486569 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-tls\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.486978 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.486795 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-grpc-tls\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.486978 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.486934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.488901 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.488794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.489927 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.489883 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00396778-bb09-43f5-8829-72052aab3e12-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.494738 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.494710 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln6wj\" (UniqueName: \"kubernetes.io/projected/00396778-bb09-43f5-8829-72052aab3e12-kube-api-access-ln6wj\") pod \"thanos-querier-bd68f9587-g68g7\" (UID: \"00396778-bb09-43f5-8829-72052aab3e12\") " pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:09.605154 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:09.605091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:10.153683 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:10.153368 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" event={"ID":"d14b7d71-f269-4a91-ad62-051c422dec54","Type":"ContainerStarted","Data":"9faa0faea9cfcbea351f0e34376b3458089c9a06a4075c48056167e24cc21063"} Jul 23 15:21:10.155849 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:10.155811 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pg8" event={"ID":"3d611547-f182-4600-ae88-436b50ed0dc7","Type":"ContainerStarted","Data":"d1b4194255f1ee0712857cc79fd3b4214fee7aeb688513bcd03eddda5fab8f3a"} Jul 23 15:21:10.155943 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:10.155857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pg8" event={"ID":"3d611547-f182-4600-ae88-436b50ed0dc7","Type":"ContainerStarted","Data":"9779f79ba974cf75d0ae84aec7ea26ca0d8fdfe4b4620a2f0203c6338edaf6d6"} Jul 23 15:21:10.173221 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:10.173172 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6n9dt" podStartSLOduration=2.702678113 podStartE2EDuration="4.173155698s" totalImagesPullingTime="1.470477585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:10.172885337 +0000 UTC m=+84.020538886" watchObservedRunningTime="2026-07-23 15:21:10.173155698 +0000 UTC m=+84.020809236" Jul 23 15:21:10.195800 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:10.195746 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b9pg8" podStartSLOduration=3.096596427 podStartE2EDuration="4.195725522s" totalImagesPullingTime="1.012624739s" totalInitContainerRuntime="86.504356ms" isStatefulPod=true podCreationTimestamp="2026-07-23 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:10.194861824 +0000 UTC m=+84.042515372" watchObservedRunningTime="2026-07-23 15:21:10.195725522 +0000 UTC m=+84.043379039" Jul 23 15:21:11.104971 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.104936 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96"] Jul 23 15:21:11.118884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.118854 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96"] Jul 23 15:21:11.119051 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.118970 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.122778 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.122738 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 15:21:11.123731 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.123712 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-454cz\"" Jul 23 15:21:11.197380 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.197313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7nt\" (UniqueName: \"kubernetes.io/projected/a3e0e152-4bd3-4334-b4c6-bebd28023789-kube-api-access-2p7nt\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.197380 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.197375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e0e152-4bd3-4334-b4c6-bebd28023789-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.298576 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.298264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7nt\" (UniqueName: \"kubernetes.io/projected/a3e0e152-4bd3-4334-b4c6-bebd28023789-kube-api-access-2p7nt\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.298576 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.298313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e0e152-4bd3-4334-b4c6-bebd28023789-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.299046 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:21:11.298932 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 23 15:21:11.299046 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:21:11.299001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e0e152-4bd3-4334-b4c6-bebd28023789-monitoring-plugin-cert podName:a3e0e152-4bd3-4334-b4c6-bebd28023789 nodeName:}" failed. No retries permitted until 2026-07-23 15:21:11.798979986 +0000 UTC m=+85.646633520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a3e0e152-4bd3-4334-b4c6-bebd28023789-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-rtm96" (UID: "a3e0e152-4bd3-4334-b4c6-bebd28023789") : secret "monitoring-plugin-cert" not found Jul 23 15:21:11.307875 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.307849 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7nt\" (UniqueName: \"kubernetes.io/projected/a3e0e152-4bd3-4334-b4c6-bebd28023789-kube-api-access-2p7nt\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.740998 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.739114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bd68f9587-g68g7"] Jul 23 15:21:11.743819 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:21:11.743789 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00396778_bb09_43f5_8829_72052aab3e12.slice/crio-0b68a23742a31d78d27ee2ea908383235066808534d2b877027337328aea7bda WatchSource:0}: Error finding container 0b68a23742a31d78d27ee2ea908383235066808534d2b877027337328aea7bda: Status 404 returned error can't find the container with id 0b68a23742a31d78d27ee2ea908383235066808534d2b877027337328aea7bda Jul 23 15:21:11.803602 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.803571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e0e152-4bd3-4334-b4c6-bebd28023789-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:11.806191 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:11.806166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e0e152-4bd3-4334-b4c6-bebd28023789-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rtm96\" (UID: \"a3e0e152-4bd3-4334-b4c6-bebd28023789\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:12.030108 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.030005 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:12.158450 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.158418 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96"] Jul 23 15:21:12.162746 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:21:12.162718 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e0e152_4bd3_4334_b4c6_bebd28023789.slice/crio-a7db4e16a5734d8e8012842b3c0dc418ae1e424b14b8bf45ed541d2a657f5322 WatchSource:0}: Error finding container a7db4e16a5734d8e8012842b3c0dc418ae1e424b14b8bf45ed541d2a657f5322: Status 404 returned error can't find the container with id a7db4e16a5734d8e8012842b3c0dc418ae1e424b14b8bf45ed541d2a657f5322 Jul 23 15:21:12.170957 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.169177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzq7n" event={"ID":"e2f6e626-b322-49aa-9be6-1a4b72e1a6a9","Type":"ContainerStarted","Data":"84c6bbd4cd1b81fc6623a88170da70898feffd679c268ae94e1a0e8786ca94ef"} Jul 23 15:21:12.177280 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.177254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" event={"ID":"83d87f52-2895-4143-b871-f41f3fee17c0","Type":"ContainerStarted","Data":"daf05563ea9732db7770e797ad60b31059137574edbe308c73a94f1d3f2da827"} Jul 23 15:21:12.177422 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.177365 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" event={"ID":"83d87f52-2895-4143-b871-f41f3fee17c0","Type":"ContainerStarted","Data":"70ff4ef860af5fb89283baa936316154fdcf5cfe0852675a081466b586721685"} Jul 23 15:21:12.177422 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.177405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" event={"ID":"83d87f52-2895-4143-b871-f41f3fee17c0","Type":"ContainerStarted","Data":"83850b997ec946bf6362056c87dbf48556ac19121f15333ca8dfc2ab6ba90cb1"} Jul 23 15:21:12.178351 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.178329 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"0b68a23742a31d78d27ee2ea908383235066808534d2b877027337328aea7bda"} Jul 23 15:21:12.187333 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.187285 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lzq7n" podStartSLOduration=33.339190264 podStartE2EDuration="45.187269165s" totalImagesPullingTime="11.848078901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:20:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:12.186418268 +0000 UTC m=+86.034071806" watchObservedRunningTime="2026-07-23 15:21:12.187269165 +0000 UTC m=+86.034922704" Jul 23 15:21:12.207576 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.207533 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-rqcx8" podStartSLOduration=2.918221179 podStartE2EDuration="6.207517547s" totalImagesPullingTime="3.289296368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:12.206754025 +0000 UTC m=+86.054407566" watchObservedRunningTime="2026-07-23 15:21:12.207517547 +0000 UTC m=+86.055171085" Jul 23 15:21:12.600519 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.600485 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:21:12.603721 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.603683 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.606167 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606139 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 15:21:12.606403 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606379 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 15:21:12.606528 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606442 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 15:21:12.606528 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606500 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 15:21:12.606639 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606578 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 15:21:12.606916 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606742 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a1d7c5sj2u4dr\"" Jul 23 15:21:12.606916 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606840 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 15:21:12.606916 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.606845 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 15:21:12.607442 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.607205 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 15:21:12.607442 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.607262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dsnqz\"" Jul 23 15:21:12.607442 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.607276 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 15:21:12.607442 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.607326 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 15:21:12.607735 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.607700 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 15:21:12.608009 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.607985 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 15:21:12.609104 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.608595 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 15:21:12.610912 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.610889 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 15:21:12.613770 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.613752 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 15:21:12.623389 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.623364 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:21:12.711122 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711122 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711364 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711819 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bnfc\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-kube-api-access-2bnfc\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711819 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711819 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711819 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.711819 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.711691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813072 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813072 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813074 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bnfc\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-kube-api-access-2bnfc\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.813322 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814103 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.813638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814578 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.814227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.814830 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.814806 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.816425 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.815358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.816694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.816629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.817209 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.817149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.817304 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.817227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.817304 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.817250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.817304 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.817256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.817615 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.817592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.818246 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.818222 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.818646 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.818624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.819448 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.819403 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.819542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.819511 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.819981 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.819958 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.820350 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.820329 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.820582 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.820559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.821506 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.821462 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.821845 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.821823 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.822156 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.822129 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.823280 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.823255 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bnfc\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-kube-api-access-2bnfc\") pod \"prometheus-k8s-0\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:12.916560 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:12.916479 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:13.093183 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:13.093154 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:21:13.097033 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:21:13.097001 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2ad67c_67fe_4044_857e_16bfd2211ac7.slice/crio-d49c227df77e34fbea480fa1eb94c24fe489876ff3b6e9edc2759055d6ccbe0b WatchSource:0}: Error finding container d49c227df77e34fbea480fa1eb94c24fe489876ff3b6e9edc2759055d6ccbe0b: Status 404 returned error can't find the container with id d49c227df77e34fbea480fa1eb94c24fe489876ff3b6e9edc2759055d6ccbe0b Jul 23 15:21:13.183645 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:13.183562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" event={"ID":"a3e0e152-4bd3-4334-b4c6-bebd28023789","Type":"ContainerStarted","Data":"a7db4e16a5734d8e8012842b3c0dc418ae1e424b14b8bf45ed541d2a657f5322"} Jul 23 15:21:13.184691 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:13.184650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"d49c227df77e34fbea480fa1eb94c24fe489876ff3b6e9edc2759055d6ccbe0b"} Jul 23 15:21:15.193686 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.193633 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" exitCode=0 Jul 23 15:21:15.194038 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.193699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} Jul 23 15:21:15.195989 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.195962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"200d7a2d1cacd0048c97851cbb684a05809ea60af5c2adcf3a33938dc147d181"} Jul 23 15:21:15.196096 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.196020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"14e16f7d1548f12bb31af73a237f075832580dbf6f8ab61e496a7a180c9c5401"} Jul 23 15:21:15.196096 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.196045 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"10c5833ff84fceddf298a76f5f8ed4596e7f5f35961984a1c7732a6bd953fbcc"} Jul 23 15:21:15.197851 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.197829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" event={"ID":"a3e0e152-4bd3-4334-b4c6-bebd28023789","Type":"ContainerStarted","Data":"fb1c0f39cbd4ada4fcf9221513f4d41d44ba5a62c113a8ac44e6217cbf282f48"} Jul 23 15:21:15.198048 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.198025 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:15.202869 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.202848 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" Jul 23 15:21:15.244924 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:15.244876 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rtm96" podStartSLOduration=1.9654312969999999 podStartE2EDuration="4.244859906s" totalImagesPullingTime="2.279428609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:15.244173897 +0000 UTC m=+89.091827459" watchObservedRunningTime="2026-07-23 15:21:15.244859906 +0000 UTC m=+89.092513443" Jul 23 15:21:16.078938 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:16.078914 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:21:16.208458 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:16.208414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"5796e06c120e79761562b48f13e23955190598f5d5fd9a502bec1308505777a8"} Jul 23 15:21:16.208956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:16.208545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"c234dd2f1b3130ea4452d28b141447301c96d3bb1bd3bc192609c4c7961194fe"} Jul 23 15:21:16.208956 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:16.208587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" event={"ID":"00396778-bb09-43f5-8829-72052aab3e12","Type":"ContainerStarted","Data":"7d869bd68c1cbee2e3ba7a9438c6b78346f58ebed8749a9a2e934732805d7682"} Jul 23 15:21:16.234187 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:16.234132 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" podStartSLOduration=3.565078228 podStartE2EDuration="7.234116034s" totalImagesPullingTime="3.669037806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:21:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:16.23371737 +0000 UTC m=+90.081370910" watchObservedRunningTime="2026-07-23 15:21:16.234116034 +0000 UTC m=+90.081769572" Jul 23 15:21:17.213248 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:17.213200 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:19.093089 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.093060 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66f99d5d7f-9rbm7" Jul 23 15:21:19.223979 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.223941 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} Jul 23 15:21:19.224113 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.224026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} Jul 23 15:21:19.224113 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.224067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} Jul 23 15:21:19.224113 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.224101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} Jul 23 15:21:19.224402 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.224133 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} Jul 23 15:21:19.224402 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.224166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerStarted","Data":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} Jul 23 15:21:19.256196 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:19.256121 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.835054388 podStartE2EDuration="7.25609701s" totalImagesPullingTime="4.396469392s" totalInitContainerRuntime="24.57323ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:21:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:21:19.253855537 +0000 UTC m=+93.101509077" watchObservedRunningTime="2026-07-23 15:21:19.25609701 +0000 UTC m=+93.103750548" Jul 23 15:21:21.094328 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.094279 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" podUID="804f6d55-2dd0-4b8e-8cec-3531362eb251" containerName="registry" containerID="cri-o://4c2d5c17a88e44a6165a12f05fd6a99663dc956b97c22066e866722d28daff42" gracePeriod=30 Jul 23 15:21:21.233228 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.233196 2575 generic.go:356] "Generic (PLEG): container finished" podID="804f6d55-2dd0-4b8e-8cec-3531362eb251" containerID="4c2d5c17a88e44a6165a12f05fd6a99663dc956b97c22066e866722d28daff42" exitCode=0 Jul 23 15:21:21.233389 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.233241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" event={"ID":"804f6d55-2dd0-4b8e-8cec-3531362eb251","Type":"ContainerDied","Data":"4c2d5c17a88e44a6165a12f05fd6a99663dc956b97c22066e866722d28daff42"} Jul 23 15:21:21.340982 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.340957 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:21:21.493542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493455 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-certificates\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493500 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxx5\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-kube-api-access-pzxx5\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493517 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-installation-pull-secrets\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493542 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493537 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-image-registry-private-configuration\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493871 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493784 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493871 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493826 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-bound-sa-token\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493991 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493879 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-trusted-ca\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.493991 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.493917 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804f6d55-2dd0-4b8e-8cec-3531362eb251-ca-trust-extracted\") pod \"804f6d55-2dd0-4b8e-8cec-3531362eb251\" (UID: \"804f6d55-2dd0-4b8e-8cec-3531362eb251\") " Jul 23 15:21:21.494092 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.494076 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:21:21.494242 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.494221 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-certificates\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.494637 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.494516 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:21:21.496326 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.496289 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:21:21.496418 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.496337 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:21:21.496472 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.496414 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-kube-api-access-pzxx5" (OuterVolumeSpecName: "kube-api-access-pzxx5") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "kube-api-access-pzxx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:21:21.496602 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.496574 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:21:21.496837 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.496818 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:21:21.503041 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.503020 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f6d55-2dd0-4b8e-8cec-3531362eb251-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "804f6d55-2dd0-4b8e-8cec-3531362eb251" (UID: "804f6d55-2dd0-4b8e-8cec-3531362eb251"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:21:21.595264 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595228 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-image-registry-private-configuration\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.595264 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595256 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-registry-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.595264 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595265 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-bound-sa-token\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.595264 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595273 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804f6d55-2dd0-4b8e-8cec-3531362eb251-trusted-ca\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.595515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595281 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804f6d55-2dd0-4b8e-8cec-3531362eb251-ca-trust-extracted\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.595515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595289 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxx5\" (UniqueName: \"kubernetes.io/projected/804f6d55-2dd0-4b8e-8cec-3531362eb251-kube-api-access-pzxx5\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:21.595515 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:21.595299 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804f6d55-2dd0-4b8e-8cec-3531362eb251-installation-pull-secrets\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:21:22.239098 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.239074 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" Jul 23 15:21:22.239524 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.239076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d9d6db559-mj5c9" event={"ID":"804f6d55-2dd0-4b8e-8cec-3531362eb251","Type":"ContainerDied","Data":"990d019c07013820bc44a82796ce72a44d30fb764f4bf3c5c30bfc58f82177b5"} Jul 23 15:21:22.239524 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.239206 2575 scope.go:117] "RemoveContainer" containerID="4c2d5c17a88e44a6165a12f05fd6a99663dc956b97c22066e866722d28daff42" Jul 23 15:21:22.292362 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.292333 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d9d6db559-mj5c9"] Jul 23 15:21:22.298482 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.298457 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d9d6db559-mj5c9"] Jul 23 15:21:22.748413 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.748380 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="804f6d55-2dd0-4b8e-8cec-3531362eb251" path="/var/lib/kubelet/pods/804f6d55-2dd0-4b8e-8cec-3531362eb251/volumes" Jul 23 15:21:22.917497 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:22.917466 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:21:23.223548 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:23.223521 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-bd68f9587-g68g7" Jul 23 15:21:29.091439 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:21:29.091414 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hf4mp" Jul 23 15:22:12.917730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:12.917686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:12.938308 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:12.938283 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:13.449901 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:13.449865 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:30.961230 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961194 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:22:30.961682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961510 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="prometheus" containerID="cri-o://f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" gracePeriod=600 Jul 23 15:22:30.961682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961532 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" gracePeriod=600 Jul 23 15:22:30.961682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961562 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="thanos-sidecar" containerID="cri-o://a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" gracePeriod=600 Jul 23 15:22:30.961682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961593 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="config-reloader" containerID="cri-o://8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" gracePeriod=600 Jul 23 15:22:30.961682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961637 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy" containerID="cri-o://08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" gracePeriod=600 Jul 23 15:22:30.961682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:30.961589 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-web" containerID="cri-o://9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" gracePeriod=600 Jul 23 15:22:31.198961 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.198926 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.260803 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260691 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-1\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.260803 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260746 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-tls-assets\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.260803 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260775 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-serving-certs-ca-bundle\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260810 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config-out\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260884 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-db\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260916 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260955 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-metrics-client-certs\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.260987 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261016 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-tls\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261044 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-kubelet-serving-ca-bundle\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261069 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-thanos-prometheus-http-client-file\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261095 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-2\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bnfc\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-kube-api-access-2bnfc\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261153 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-kube-rbac-proxy\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-grpc-tls\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261240 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261228 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-trusted-ca-bundle\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261910 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261254 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261910 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261283 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-metrics-client-ca\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261910 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261307 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-0\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.261910 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.261338 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-web-config\") pod \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\" (UID: \"1a2ad67c-67fe-4044-857e-16bfd2211ac7\") " Jul 23 15:22:31.262371 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.262092 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.263557 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.263296 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.263799 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.263769 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.264264 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.264235 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.264607 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.264570 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.264726 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.264644 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.265070 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.265044 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:22:31.266886 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.266331 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.266886 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.266348 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.267791 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.267492 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config" (OuterVolumeSpecName: "config") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.267791 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.267651 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-kube-api-access-2bnfc" (OuterVolumeSpecName: "kube-api-access-2bnfc") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "kube-api-access-2bnfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:22:31.267962 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.267800 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:22:31.267962 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.267828 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:22:31.267962 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.267840 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.267962 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.267943 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config-out" (OuterVolumeSpecName: "config-out") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:22:31.268242 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.268215 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.268328 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.268240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.268713 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.268694 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.268841 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.268822 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.278189 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.278160 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-web-config" (OuterVolumeSpecName: "web-config") pod "1a2ad67c-67fe-4044-857e-16bfd2211ac7" (UID: "1a2ad67c-67fe-4044-857e-16bfd2211ac7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:22:31.362408 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362357 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-db\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362408 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362407 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362408 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362418 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-metrics-client-certs\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362408 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362428 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362437 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362446 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362455 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362464 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362472 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bnfc\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-kube-api-access-2bnfc\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362481 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-kube-rbac-proxy\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362489 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-grpc-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362497 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362505 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362514 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-metrics-client-ca\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362522 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362532 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a2ad67c-67fe-4044-857e-16bfd2211ac7-web-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362541 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362550 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a2ad67c-67fe-4044-857e-16bfd2211ac7-tls-assets\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362557 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a2ad67c-67fe-4044-857e-16bfd2211ac7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.362730 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.362565 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a2ad67c-67fe-4044-857e-16bfd2211ac7-config-out\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:22:31.504833 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504793 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" exitCode=0 Jul 23 15:22:31.504833 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504821 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" exitCode=0 Jul 23 15:22:31.504833 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504828 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" exitCode=0 Jul 23 15:22:31.504833 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504833 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" exitCode=0 Jul 23 15:22:31.504833 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504838 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" exitCode=0 Jul 23 15:22:31.504833 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504843 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" exitCode=0 Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504897 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504930 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.504999 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.505010 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.505036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} Jul 23 15:22:31.505277 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.505058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a2ad67c-67fe-4044-857e-16bfd2211ac7","Type":"ContainerDied","Data":"d49c227df77e34fbea480fa1eb94c24fe489876ff3b6e9edc2759055d6ccbe0b"} Jul 23 15:22:31.513361 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.513338 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.521343 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.521319 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.528513 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.528494 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.534051 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.534020 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:22:31.536491 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.536476 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.541801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.541774 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:22:31.544866 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.544847 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.553064 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.553041 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.560433 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.560414 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.560821 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.560800 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.560887 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.560833 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} err="failed to get container status \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" Jul 23 15:22:31.560887 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.560874 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.561171 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.561148 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.561216 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561179 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} err="failed to get container status \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" Jul 23 15:22:31.561216 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561205 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.561440 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.561422 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.561485 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561444 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} err="failed to get container status \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" Jul 23 15:22:31.561485 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561458 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.561688 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.561646 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.561726 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561697 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} err="failed to get container status \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" Jul 23 15:22:31.561726 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561714 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.561967 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.561950 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.562028 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561969 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} err="failed to get container status \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" Jul 23 15:22:31.562028 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.561982 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.562207 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.562188 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.562250 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562210 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} err="failed to get container status \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" Jul 23 15:22:31.562250 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562221 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.562429 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:22:31.562413 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.562464 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562433 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} err="failed to get container status \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" Jul 23 15:22:31.562464 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562446 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.562626 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562611 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} err="failed to get container status \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" Jul 23 15:22:31.562681 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562626 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.562850 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562831 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} err="failed to get container status \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" Jul 23 15:22:31.562900 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.562849 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.563069 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563054 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} err="failed to get container status \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" Jul 23 15:22:31.563069 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563068 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.563276 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563261 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} err="failed to get container status \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" Jul 23 15:22:31.563276 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563275 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.563475 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563456 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} err="failed to get container status \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" Jul 23 15:22:31.563527 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563477 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.563682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563644 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} err="failed to get container status \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" Jul 23 15:22:31.563682 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563680 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.563899 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563884 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} err="failed to get container status \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" Jul 23 15:22:31.563944 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.563899 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.564136 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564116 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} err="failed to get container status \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" Jul 23 15:22:31.564181 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564137 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.564373 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564356 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} err="failed to get container status \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" Jul 23 15:22:31.564373 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564372 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.564591 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564575 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} err="failed to get container status \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" Jul 23 15:22:31.564638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564592 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.564851 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564827 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} err="failed to get container status \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" Jul 23 15:22:31.564851 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.564846 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.565111 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565090 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} err="failed to get container status \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" Jul 23 15:22:31.565111 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565111 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.565383 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565333 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} err="failed to get container status \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" Jul 23 15:22:31.565383 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565355 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.565622 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565604 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} err="failed to get container status \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" Jul 23 15:22:31.565695 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565623 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.565884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565866 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} err="failed to get container status \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" Jul 23 15:22:31.565948 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.565885 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.566099 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566075 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} err="failed to get container status \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" Jul 23 15:22:31.566099 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566097 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.566355 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566339 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} err="failed to get container status \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" Jul 23 15:22:31.566355 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566355 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.566585 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566568 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} err="failed to get container status \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" Jul 23 15:22:31.566637 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566586 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.566831 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566814 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} err="failed to get container status \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" Jul 23 15:22:31.566886 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.566832 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.567047 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567030 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} err="failed to get container status \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" Jul 23 15:22:31.567085 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567048 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.567251 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567233 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} err="failed to get container status \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" Jul 23 15:22:31.567295 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567253 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.567463 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567447 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} err="failed to get container status \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" Jul 23 15:22:31.567504 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567462 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.567683 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567646 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} err="failed to get container status \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" Jul 23 15:22:31.567683 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567680 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.567874 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567858 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} err="failed to get container status \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" Jul 23 15:22:31.567921 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.567876 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.568089 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568074 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} err="failed to get container status \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" Jul 23 15:22:31.568089 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568088 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.568287 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568269 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} err="failed to get container status \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" Jul 23 15:22:31.568325 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568286 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.568481 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568458 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} err="failed to get container status \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" Jul 23 15:22:31.568550 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568483 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.568717 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568701 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} err="failed to get container status \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" Jul 23 15:22:31.568769 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568718 2575 scope.go:117] "RemoveContainer" containerID="d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6" Jul 23 15:22:31.568924 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568909 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6"} err="failed to get container status \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": rpc error: code = NotFound desc = could not find container \"d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6\": container with ID starting with d5f12760b737ab2d584c908d9bc347838a493b58baa4efb039fc5a65aa1530c6 not found: ID does not exist" Jul 23 15:22:31.568970 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.568924 2575 scope.go:117] "RemoveContainer" containerID="08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e" Jul 23 15:22:31.569105 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569089 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e"} err="failed to get container status \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": rpc error: code = NotFound desc = could not find container \"08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e\": container with ID starting with 08fc8c3aa5509101fb458360f28d4672adc8a6dc41b5d6eb47a7d2e82409f17e not found: ID does not exist" Jul 23 15:22:31.569147 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569105 2575 scope.go:117] "RemoveContainer" containerID="9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3" Jul 23 15:22:31.569316 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569299 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3"} err="failed to get container status \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": rpc error: code = NotFound desc = could not find container \"9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3\": container with ID starting with 9ccbf0f48cf97fb281cd3301fa50557bd3461d417c2e2a487722f8311f152fd3 not found: ID does not exist" Jul 23 15:22:31.569354 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569317 2575 scope.go:117] "RemoveContainer" containerID="a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327" Jul 23 15:22:31.569536 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569514 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327"} err="failed to get container status \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": rpc error: code = NotFound desc = could not find container \"a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327\": container with ID starting with a7fbc310f40f69a9529cb3fdbd9a82ce0567969ca82ec04d6cf867ace9b2f327 not found: ID does not exist" Jul 23 15:22:31.569536 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569536 2575 scope.go:117] "RemoveContainer" containerID="8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a" Jul 23 15:22:31.569729 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569714 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a"} err="failed to get container status \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": rpc error: code = NotFound desc = could not find container \"8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a\": container with ID starting with 8f8ae6e9b1b4313eff3f57ee5cdeb03978256384a897f80c6143e3c148a7153a not found: ID does not exist" Jul 23 15:22:31.569766 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569729 2575 scope.go:117] "RemoveContainer" containerID="f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa" Jul 23 15:22:31.569940 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569925 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa"} err="failed to get container status \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": rpc error: code = NotFound desc = could not find container \"f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa\": container with ID starting with f2b721b938643f8f58a6d9be2da51a38b0b3bd8405a3ac928dabe9f016cb9efa not found: ID does not exist" Jul 23 15:22:31.569940 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.569940 2575 scope.go:117] "RemoveContainer" containerID="195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514" Jul 23 15:22:31.570130 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.570114 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514"} err="failed to get container status \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": rpc error: code = NotFound desc = could not find container \"195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514\": container with ID starting with 195189d93c00a2289f9d6a7d5beb0bda87ce5479a1cc691b7e15da32222a3514 not found: ID does not exist" Jul 23 15:22:31.575413 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575389 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:22:31.575675 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575640 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="init-config-reloader" Jul 23 15:22:31.575675 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575670 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="init-config-reloader" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575685 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575691 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575699 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="config-reloader" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575705 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="config-reloader" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575712 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="thanos-sidecar" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575717 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="thanos-sidecar" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804f6d55-2dd0-4b8e-8cec-3531362eb251" containerName="registry" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575727 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="804f6d55-2dd0-4b8e-8cec-3531362eb251" containerName="registry" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575733 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-web" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575738 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-web" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575743 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="prometheus" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575749 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="prometheus" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575758 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-thanos" Jul 23 15:22:31.575768 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575762 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-thanos" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575803 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="thanos-sidecar" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575811 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="prometheus" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575817 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575822 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-thanos" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575828 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="804f6d55-2dd0-4b8e-8cec-3531362eb251" containerName="registry" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575833 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="config-reloader" Jul 23 15:22:31.576217 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.575837 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" containerName="kube-rbac-proxy-web" Jul 23 15:22:31.579599 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.579583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.582888 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.582867 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 15:22:31.583046 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583034 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 15:22:31.583115 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583039 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 15:22:31.583538 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583519 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 15:22:31.583697 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583622 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 15:22:31.583804 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583699 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 15:22:31.583894 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583872 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a1d7c5sj2u4dr\"" Jul 23 15:22:31.583984 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583961 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 15:22:31.584091 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.583991 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dsnqz\"" Jul 23 15:22:31.584091 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.584021 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 15:22:31.584169 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.584113 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 15:22:31.584169 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.584164 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 15:22:31.584275 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.584233 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 15:22:31.584338 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.584313 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 15:22:31.585935 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.585914 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 15:22:31.592435 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.592180 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 15:22:31.593566 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.593547 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 15:22:31.616129 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.616096 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:22:31.664669 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08bd213d-8f54-4ac2-9e04-7bc1d881779d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08bd213d-8f54-4ac2-9e04-7bc1d881779d-config-out\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664997 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664997 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664997 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664997 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.664997 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.664973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-config\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-web-config\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665166 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxk7k\" (UniqueName: \"kubernetes.io/projected/08bd213d-8f54-4ac2-9e04-7bc1d881779d-kube-api-access-zxk7k\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665332 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665332 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665332 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.665332 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.665260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766397 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08bd213d-8f54-4ac2-9e04-7bc1d881779d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08bd213d-8f54-4ac2-9e04-7bc1d881779d-config-out\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.766737 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-config\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-web-config\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxk7k\" (UniqueName: \"kubernetes.io/projected/08bd213d-8f54-4ac2-9e04-7bc1d881779d-kube-api-access-zxk7k\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767152 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.766955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767476 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.767164 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767476 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.767340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767476 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.767386 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.767633 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.767504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.769718 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.769687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08bd213d-8f54-4ac2-9e04-7bc1d881779d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.769852 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.769827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770173 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08bd213d-8f54-4ac2-9e04-7bc1d881779d-config-out\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770271 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770354 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770770 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770770 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770770 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.770965 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.770942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.771205 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.771147 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08bd213d-8f54-4ac2-9e04-7bc1d881779d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.772696 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.772671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-config\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.772801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.772702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-web-config\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.773027 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.773006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.773113 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.773095 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08bd213d-8f54-4ac2-9e04-7bc1d881779d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.780307 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.780288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxk7k\" (UniqueName: \"kubernetes.io/projected/08bd213d-8f54-4ac2-9e04-7bc1d881779d-kube-api-access-zxk7k\") pod \"prometheus-k8s-0\" (UID: \"08bd213d-8f54-4ac2-9e04-7bc1d881779d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:31.890921 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:31.890882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:22:32.046451 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:32.046426 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:22:32.048911 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:22:32.048885 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08bd213d_8f54_4ac2_9e04_7bc1d881779d.slice/crio-af9d19dcf8a731719a2865e29c263c1327e61292ddaa47d6c1c7cd5fae74594b WatchSource:0}: Error finding container af9d19dcf8a731719a2865e29c263c1327e61292ddaa47d6c1c7cd5fae74594b: Status 404 returned error can't find the container with id af9d19dcf8a731719a2865e29c263c1327e61292ddaa47d6c1c7cd5fae74594b Jul 23 15:22:32.509791 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:32.509756 2575 generic.go:356] "Generic (PLEG): container finished" podID="08bd213d-8f54-4ac2-9e04-7bc1d881779d" containerID="d669cc66238b6bd255c23aec285af54d400a4978ef30d714862ed7cd6227607b" exitCode=0 Jul 23 15:22:32.509957 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:32.509839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerDied","Data":"d669cc66238b6bd255c23aec285af54d400a4978ef30d714862ed7cd6227607b"} Jul 23 15:22:32.509957 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:32.509899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"af9d19dcf8a731719a2865e29c263c1327e61292ddaa47d6c1c7cd5fae74594b"} Jul 23 15:22:32.752507 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:32.751750 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2ad67c-67fe-4044-857e-16bfd2211ac7" path="/var/lib/kubelet/pods/1a2ad67c-67fe-4044-857e-16bfd2211ac7/volumes" Jul 23 15:22:33.517702 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:33.517639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"ca24870a758b30756f4bb9afbcff5630bd2493a6e1604773bd6a741148553fc8"} Jul 23 15:22:33.518336 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:33.517746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"c90262ae36cdc826760ff4b843b3054753574a1184f17a08ca654809ee5bdad0"} Jul 23 15:22:33.518336 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:33.518074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"5dbedf66dd353aade6ded2edbb2a4fe4aac36d600502638306c731fd2f3ab09d"} Jul 23 15:22:33.518336 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:33.518163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"f398aed13e2b9a288e09feb25c038a541958700159f2672d342005e7cd1164b5"} Jul 23 15:22:33.518495 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:33.518442 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"dc9d345518eaec6a8a3495ee21049a7766b02c247e330c482f36da088302018e"} Jul 23 15:22:33.518582 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:33.518535 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08bd213d-8f54-4ac2-9e04-7bc1d881779d","Type":"ContainerStarted","Data":"69f132981b921223264d27c25f15e5038b863d9979702a4484d927ea6ba68bb4"} Jul 23 15:22:36.891815 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:22:36.891716 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:23:31.891346 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:23:31.891311 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:23:31.907468 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:23:31.907441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:23:31.939454 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:23:31.939382 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=60.919933719 podStartE2EDuration="1m0.939361689s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.42797ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:22:33.579377316 +0000 UTC m=+167.427030876" watchObservedRunningTime="2026-07-23 15:23:31.939361689 +0000 UTC m=+225.787015295" Jul 23 15:23:32.748644 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:23:32.748615 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:24:46.539950 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:24:46.539914 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:24:46.545727 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:24:46.545701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:24:46.547274 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:24:46.547254 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 15:25:50.864622 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.864586 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-pddbw"] Jul 23 15:25:50.866965 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.866947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:50.869256 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.869238 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 23 15:25:50.869315 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.869284 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:25:50.870184 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.870167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-8d47l\"" Jul 23 15:25:50.875790 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.875769 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-pddbw"] Jul 23 15:25:50.955082 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.955043 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9tg\" (UniqueName: \"kubernetes.io/projected/f0343603-155e-48fa-9213-c8c1148ec8f9-kube-api-access-8h9tg\") pod \"jobset-operator-5bc45f897-pddbw\" (UID: \"f0343603-155e-48fa-9213-c8c1148ec8f9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:50.955269 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:50.955091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0343603-155e-48fa-9213-c8c1148ec8f9-tmp\") pod \"jobset-operator-5bc45f897-pddbw\" (UID: \"f0343603-155e-48fa-9213-c8c1148ec8f9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:51.056477 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.056442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0343603-155e-48fa-9213-c8c1148ec8f9-tmp\") pod \"jobset-operator-5bc45f897-pddbw\" (UID: \"f0343603-155e-48fa-9213-c8c1148ec8f9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:51.056704 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.056544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9tg\" (UniqueName: \"kubernetes.io/projected/f0343603-155e-48fa-9213-c8c1148ec8f9-kube-api-access-8h9tg\") pod \"jobset-operator-5bc45f897-pddbw\" (UID: \"f0343603-155e-48fa-9213-c8c1148ec8f9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:51.056914 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.056891 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0343603-155e-48fa-9213-c8c1148ec8f9-tmp\") pod \"jobset-operator-5bc45f897-pddbw\" (UID: \"f0343603-155e-48fa-9213-c8c1148ec8f9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:51.065218 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.065195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9tg\" (UniqueName: \"kubernetes.io/projected/f0343603-155e-48fa-9213-c8c1148ec8f9-kube-api-access-8h9tg\") pod \"jobset-operator-5bc45f897-pddbw\" (UID: \"f0343603-155e-48fa-9213-c8c1148ec8f9\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:51.183839 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.183755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" Jul 23 15:25:51.312407 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.312387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-pddbw"] Jul 23 15:25:51.315242 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:25:51.315218 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0343603_155e_48fa_9213_c8c1148ec8f9.slice/crio-cf081c585e85df651e069a52b515053d7005284a228afb2061fdbea464508f8c WatchSource:0}: Error finding container cf081c585e85df651e069a52b515053d7005284a228afb2061fdbea464508f8c: Status 404 returned error can't find the container with id cf081c585e85df651e069a52b515053d7005284a228afb2061fdbea464508f8c Jul 23 15:25:51.317100 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:51.317081 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 15:25:52.224513 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:25:52.224475 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" event={"ID":"f0343603-155e-48fa-9213-c8c1148ec8f9","Type":"ContainerStarted","Data":"cf081c585e85df651e069a52b515053d7005284a228afb2061fdbea464508f8c"} Jul 23 15:26:02.261780 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:26:02.261740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" event={"ID":"f0343603-155e-48fa-9213-c8c1148ec8f9","Type":"ContainerStarted","Data":"b2a744c3dbd6dc0ea11c73f7015ec5c8bee77916d0354689be6844a6e7fd2234"} Jul 23 15:26:02.276801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:26:02.276738 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-pddbw" podStartSLOduration=2.373861946 podStartE2EDuration="12.276715966s" totalImagesPullingTime="9.90285402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:26:02.27647709 +0000 UTC m=+376.124130630" watchObservedRunningTime="2026-07-23 15:26:02.276715966 +0000 UTC m=+376.124369507" Jul 23 15:27:51.382284 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.382252 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f"] Jul 23 15:27:51.385185 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.385165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.387757 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.387717 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 15:27:51.388859 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.388833 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 23 15:27:51.388979 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.388859 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-f7t7g\"" Jul 23 15:27:51.388979 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.388833 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 15:27:51.388979 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.388905 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 23 15:27:51.398795 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.398778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f"] Jul 23 15:27:51.440131 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.440097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/789aee77-8d9d-45cb-bfd6-2450b11d6164-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.440131 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.440131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789aee77-8d9d-45cb-bfd6-2450b11d6164-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.440308 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.440250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4stzg\" (UniqueName: \"kubernetes.io/projected/789aee77-8d9d-45cb-bfd6-2450b11d6164-kube-api-access-4stzg\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.540764 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.540716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/789aee77-8d9d-45cb-bfd6-2450b11d6164-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.540764 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.540768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789aee77-8d9d-45cb-bfd6-2450b11d6164-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.540997 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.540840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4stzg\" (UniqueName: \"kubernetes.io/projected/789aee77-8d9d-45cb-bfd6-2450b11d6164-kube-api-access-4stzg\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.541328 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.541305 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/789aee77-8d9d-45cb-bfd6-2450b11d6164-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.543201 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.543178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789aee77-8d9d-45cb-bfd6-2450b11d6164-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.549846 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.549820 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stzg\" (UniqueName: \"kubernetes.io/projected/789aee77-8d9d-45cb-bfd6-2450b11d6164-kube-api-access-4stzg\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.694494 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.694418 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:51.835197 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:51.835160 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f"] Jul 23 15:27:51.838351 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:27:51.838322 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod789aee77_8d9d_45cb_bfd6_2450b11d6164.slice/crio-89e9204656425f3963a9b2b6fe3a24fbd40193ded7bd0122e23be88f144ee001 WatchSource:0}: Error finding container 89e9204656425f3963a9b2b6fe3a24fbd40193ded7bd0122e23be88f144ee001: Status 404 returned error can't find the container with id 89e9204656425f3963a9b2b6fe3a24fbd40193ded7bd0122e23be88f144ee001 Jul 23 15:27:52.677787 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:52.677750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" event={"ID":"789aee77-8d9d-45cb-bfd6-2450b11d6164","Type":"ContainerStarted","Data":"89e9204656425f3963a9b2b6fe3a24fbd40193ded7bd0122e23be88f144ee001"} Jul 23 15:27:54.688841 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:54.688809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" event={"ID":"789aee77-8d9d-45cb-bfd6-2450b11d6164","Type":"ContainerStarted","Data":"2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4"} Jul 23 15:27:54.689230 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:54.688930 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:27:54.715405 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:27:54.715308 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" podStartSLOduration=1.09441791 podStartE2EDuration="3.715293073s" totalImagesPullingTime="2.620875163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:27:54.714547989 +0000 UTC m=+488.562201553" watchObservedRunningTime="2026-07-23 15:27:54.715293073 +0000 UTC m=+488.562946611" Jul 23 15:28:10.697822 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:10.697793 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:28:14.162647 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.162611 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-79jml"] Jul 23 15:28:14.167834 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.167810 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:28:14.170694 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.170648 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tj7t8\"" Jul 23 15:28:14.180884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.180858 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-79jml"] Jul 23 15:28:14.216882 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.216854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7h4n\" (UniqueName: \"kubernetes.io/projected/143235f8-6517-486f-91e7-8f849b4e912a-kube-api-access-c7h4n\") pod \"test-trainjob-workflow-node-0-0-79jml\" (UID: \"143235f8-6517-486f-91e7-8f849b4e912a\") " pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:28:14.318140 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.318100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7h4n\" (UniqueName: \"kubernetes.io/projected/143235f8-6517-486f-91e7-8f849b4e912a-kube-api-access-c7h4n\") pod \"test-trainjob-workflow-node-0-0-79jml\" (UID: \"143235f8-6517-486f-91e7-8f849b4e912a\") " pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:28:14.332280 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.332254 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7h4n\" (UniqueName: \"kubernetes.io/projected/143235f8-6517-486f-91e7-8f849b4e912a-kube-api-access-c7h4n\") pod \"test-trainjob-workflow-node-0-0-79jml\" (UID: \"143235f8-6517-486f-91e7-8f849b4e912a\") " pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:28:14.477571 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.477482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:28:14.613320 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.613157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-79jml"] Jul 23 15:28:14.616060 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:28:14.616036 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod143235f8_6517_486f_91e7_8f849b4e912a.slice/crio-e55581d9ec3ca9e5ff7c55caa88ae800a5a80e93e7a63ec5c24691f05a1a6a65 WatchSource:0}: Error finding container e55581d9ec3ca9e5ff7c55caa88ae800a5a80e93e7a63ec5c24691f05a1a6a65: Status 404 returned error can't find the container with id e55581d9ec3ca9e5ff7c55caa88ae800a5a80e93e7a63ec5c24691f05a1a6a65 Jul 23 15:28:14.765135 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:28:14.765050 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" event={"ID":"143235f8-6517-486f-91e7-8f849b4e912a","Type":"ContainerStarted","Data":"e55581d9ec3ca9e5ff7c55caa88ae800a5a80e93e7a63ec5c24691f05a1a6a65"} Jul 23 15:29:28.094945 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:28.094911 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" event={"ID":"143235f8-6517-486f-91e7-8f849b4e912a","Type":"ContainerStarted","Data":"fe5b20b41416e03362ceed259fe28546267c69d2329dda077eeb1cdcbbf1433d"} Jul 23 15:29:28.113807 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:28.113737 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" podStartSLOduration=1.607248436 podStartE2EDuration="1m14.113718461s" totalImagesPullingTime="1m12.506470025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:29:28.113128159 +0000 UTC m=+581.960781698" watchObservedRunningTime="2026-07-23 15:29:28.113718461 +0000 UTC m=+581.961372000" Jul 23 15:29:30.103525 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:30.103492 2575 generic.go:356] "Generic (PLEG): container finished" podID="143235f8-6517-486f-91e7-8f849b4e912a" containerID="fe5b20b41416e03362ceed259fe28546267c69d2329dda077eeb1cdcbbf1433d" exitCode=0 Jul 23 15:29:30.103946 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:30.103571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" event={"ID":"143235f8-6517-486f-91e7-8f849b4e912a","Type":"ContainerDied","Data":"fe5b20b41416e03362ceed259fe28546267c69d2329dda077eeb1cdcbbf1433d"} Jul 23 15:29:31.264510 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:31.264480 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:29:31.415679 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:31.415569 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7h4n\" (UniqueName: \"kubernetes.io/projected/143235f8-6517-486f-91e7-8f849b4e912a-kube-api-access-c7h4n\") pod \"143235f8-6517-486f-91e7-8f849b4e912a\" (UID: \"143235f8-6517-486f-91e7-8f849b4e912a\") " Jul 23 15:29:31.417911 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:31.417884 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143235f8-6517-486f-91e7-8f849b4e912a-kube-api-access-c7h4n" (OuterVolumeSpecName: "kube-api-access-c7h4n") pod "143235f8-6517-486f-91e7-8f849b4e912a" (UID: "143235f8-6517-486f-91e7-8f849b4e912a"). InnerVolumeSpecName "kube-api-access-c7h4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:29:31.516968 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:31.516928 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7h4n\" (UniqueName: \"kubernetes.io/projected/143235f8-6517-486f-91e7-8f849b4e912a-kube-api-access-c7h4n\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:29:32.113091 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.113063 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" Jul 23 15:29:32.113091 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.113071 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-79jml" event={"ID":"143235f8-6517-486f-91e7-8f849b4e912a","Type":"ContainerDied","Data":"e55581d9ec3ca9e5ff7c55caa88ae800a5a80e93e7a63ec5c24691f05a1a6a65"} Jul 23 15:29:32.113300 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.113103 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e55581d9ec3ca9e5ff7c55caa88ae800a5a80e93e7a63ec5c24691f05a1a6a65" Jul 23 15:29:32.453423 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.453347 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-79jml"] Jul 23 15:29:32.456060 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.456037 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-79jml"] Jul 23 15:29:32.594996 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.594962 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f"] Jul 23 15:29:32.595225 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.595145 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" podUID="789aee77-8d9d-45cb-bfd6-2450b11d6164" containerName="manager" containerID="cri-o://2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4" gracePeriod=30 Jul 23 15:29:32.748647 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.748618 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="143235f8-6517-486f-91e7-8f849b4e912a" path="/var/lib/kubelet/pods/143235f8-6517-486f-91e7-8f849b4e912a/volumes" Jul 23 15:29:32.859627 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.859591 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:29:32.980233 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980164 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4sqgz/must-gather-hnfkk"] Jul 23 15:29:32.980503 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980485 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="143235f8-6517-486f-91e7-8f849b4e912a" containerName="node" Jul 23 15:29:32.980503 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980497 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="143235f8-6517-486f-91e7-8f849b4e912a" containerName="node" Jul 23 15:29:32.980583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980506 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789aee77-8d9d-45cb-bfd6-2450b11d6164" containerName="manager" Jul 23 15:29:32.980583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980511 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="789aee77-8d9d-45cb-bfd6-2450b11d6164" containerName="manager" Jul 23 15:29:32.980583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980563 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="789aee77-8d9d-45cb-bfd6-2450b11d6164" containerName="manager" Jul 23 15:29:32.980583 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:32.980571 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="143235f8-6517-486f-91e7-8f849b4e912a" containerName="node" Jul 23 15:29:33.015462 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.015437 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sqgz/must-gather-hnfkk"] Jul 23 15:29:33.015603 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.015530 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.018349 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.018327 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sqgz\"/\"kube-root-ca.crt\"" Jul 23 15:29:33.018349 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.018342 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sqgz\"/\"openshift-service-ca.crt\"" Jul 23 15:29:33.018548 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.018346 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4sqgz\"/\"default-dockercfg-sdfmn\"" Jul 23 15:29:33.029565 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.029157 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789aee77-8d9d-45cb-bfd6-2450b11d6164-cert\") pod \"789aee77-8d9d-45cb-bfd6-2450b11d6164\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " Jul 23 15:29:33.029565 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.029260 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4stzg\" (UniqueName: \"kubernetes.io/projected/789aee77-8d9d-45cb-bfd6-2450b11d6164-kube-api-access-4stzg\") pod \"789aee77-8d9d-45cb-bfd6-2450b11d6164\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " Jul 23 15:29:33.029565 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.029289 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/789aee77-8d9d-45cb-bfd6-2450b11d6164-kubeflow-trainer-config\") pod \"789aee77-8d9d-45cb-bfd6-2450b11d6164\" (UID: \"789aee77-8d9d-45cb-bfd6-2450b11d6164\") " Jul 23 15:29:33.032033 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.032005 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/789aee77-8d9d-45cb-bfd6-2450b11d6164-cert" (OuterVolumeSpecName: "cert") pod "789aee77-8d9d-45cb-bfd6-2450b11d6164" (UID: "789aee77-8d9d-45cb-bfd6-2450b11d6164"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:29:33.032141 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.032118 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789aee77-8d9d-45cb-bfd6-2450b11d6164-kube-api-access-4stzg" (OuterVolumeSpecName: "kube-api-access-4stzg") pod "789aee77-8d9d-45cb-bfd6-2450b11d6164" (UID: "789aee77-8d9d-45cb-bfd6-2450b11d6164"). InnerVolumeSpecName "kube-api-access-4stzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:29:33.033735 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.033716 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/789aee77-8d9d-45cb-bfd6-2450b11d6164-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "789aee77-8d9d-45cb-bfd6-2450b11d6164" (UID: "789aee77-8d9d-45cb-bfd6-2450b11d6164"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:29:33.118630 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.118597 2575 generic.go:356] "Generic (PLEG): container finished" podID="789aee77-8d9d-45cb-bfd6-2450b11d6164" containerID="2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4" exitCode=0 Jul 23 15:29:33.118801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.118646 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" Jul 23 15:29:33.118801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.118679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" event={"ID":"789aee77-8d9d-45cb-bfd6-2450b11d6164","Type":"ContainerDied","Data":"2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4"} Jul 23 15:29:33.118801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.118733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f" event={"ID":"789aee77-8d9d-45cb-bfd6-2450b11d6164","Type":"ContainerDied","Data":"89e9204656425f3963a9b2b6fe3a24fbd40193ded7bd0122e23be88f144ee001"} Jul 23 15:29:33.118801 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.118755 2575 scope.go:117] "RemoveContainer" containerID="2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4" Jul 23 15:29:33.127349 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.127331 2575 scope.go:117] "RemoveContainer" containerID="2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4" Jul 23 15:29:33.127617 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:29:33.127600 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4\": container with ID starting with 2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4 not found: ID does not exist" containerID="2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4" Jul 23 15:29:33.127710 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.127623 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4"} err="failed to get container status \"2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4\": rpc error: code = NotFound desc = could not find container \"2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4\": container with ID starting with 2d6e433ec3c80f07649213d36b5ca8c33a21a8382c867394dc5666ad2045ded4 not found: ID does not exist" Jul 23 15:29:33.129930 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.129908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0541062e-a183-4993-bdc6-7828283c54bf-must-gather-output\") pod \"must-gather-hnfkk\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.130035 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.129944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zc5d\" (UniqueName: \"kubernetes.io/projected/0541062e-a183-4993-bdc6-7828283c54bf-kube-api-access-8zc5d\") pod \"must-gather-hnfkk\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.130035 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.129980 2575 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789aee77-8d9d-45cb-bfd6-2450b11d6164-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:29:33.130035 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.129989 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4stzg\" (UniqueName: \"kubernetes.io/projected/789aee77-8d9d-45cb-bfd6-2450b11d6164-kube-api-access-4stzg\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:29:33.130035 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.130000 2575 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/789aee77-8d9d-45cb-bfd6-2450b11d6164-kubeflow-trainer-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:29:33.139007 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.138986 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f"] Jul 23 15:29:33.142651 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.142630 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-bx95f"] Jul 23 15:29:33.231011 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.230935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0541062e-a183-4993-bdc6-7828283c54bf-must-gather-output\") pod \"must-gather-hnfkk\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.231011 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.230976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zc5d\" (UniqueName: \"kubernetes.io/projected/0541062e-a183-4993-bdc6-7828283c54bf-kube-api-access-8zc5d\") pod \"must-gather-hnfkk\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.231275 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.231257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0541062e-a183-4993-bdc6-7828283c54bf-must-gather-output\") pod \"must-gather-hnfkk\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.239463 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.239438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zc5d\" (UniqueName: \"kubernetes.io/projected/0541062e-a183-4993-bdc6-7828283c54bf-kube-api-access-8zc5d\") pod \"must-gather-hnfkk\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.324470 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.324434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:29:33.492731 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:33.492705 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sqgz/must-gather-hnfkk"] Jul 23 15:29:33.495117 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:29:33.495095 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0541062e_a183_4993_bdc6_7828283c54bf.slice/crio-20a0ae257547fe38d5dafc3e77fe638020e170585a14e3dc9183aab4aae528bf WatchSource:0}: Error finding container 20a0ae257547fe38d5dafc3e77fe638020e170585a14e3dc9183aab4aae528bf: Status 404 returned error can't find the container with id 20a0ae257547fe38d5dafc3e77fe638020e170585a14e3dc9183aab4aae528bf Jul 23 15:29:34.124626 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:34.124590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" event={"ID":"0541062e-a183-4993-bdc6-7828283c54bf","Type":"ContainerStarted","Data":"20a0ae257547fe38d5dafc3e77fe638020e170585a14e3dc9183aab4aae528bf"} Jul 23 15:29:34.748640 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:34.748608 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="789aee77-8d9d-45cb-bfd6-2450b11d6164" path="/var/lib/kubelet/pods/789aee77-8d9d-45cb-bfd6-2450b11d6164/volumes" Jul 23 15:29:42.163303 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:42.163257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" event={"ID":"0541062e-a183-4993-bdc6-7828283c54bf","Type":"ContainerStarted","Data":"63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0"} Jul 23 15:29:42.164018 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:42.163979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" event={"ID":"0541062e-a183-4993-bdc6-7828283c54bf","Type":"ContainerStarted","Data":"5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7"} Jul 23 15:29:42.180574 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:42.180518 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" podStartSLOduration=2.565894254 podStartE2EDuration="10.180489058s" totalImagesPullingTime="7.614594804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:29:42.179409241 +0000 UTC m=+596.027062784" watchObservedRunningTime="2026-07-23 15:29:42.180489058 +0000 UTC m=+596.028142596" Jul 23 15:29:46.571674 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:46.571633 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:29:46.572708 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:29:46.572682 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:30:30.378330 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:30.378295 2575 generic.go:356] "Generic (PLEG): container finished" podID="0541062e-a183-4993-bdc6-7828283c54bf" containerID="5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7" exitCode=0 Jul 23 15:30:30.378824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:30.378367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" event={"ID":"0541062e-a183-4993-bdc6-7828283c54bf","Type":"ContainerDied","Data":"5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7"} Jul 23 15:30:30.378824 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:30.378713 2575 scope.go:117] "RemoveContainer" containerID="5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7" Jul 23 15:30:30.650690 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:30.650591 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4sqgz_must-gather-hnfkk_0541062e-a183-4993-bdc6-7828283c54bf/gather/0.log" Jul 23 15:30:34.435560 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:34.435532 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6p72c_b28492ba-00b6-47c8-93e7-311e6556d0bd/global-pull-secret-syncer/0.log" Jul 23 15:30:34.657703 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:34.657677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-psxwh_fa45590e-a975-44f6-97ae-1b6698141974/konnectivity-agent/0.log" Jul 23 15:30:34.758245 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:34.758166 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-153.ec2.internal_47481dd6419387374d030821f473aa00/haproxy/0.log" Jul 23 15:30:36.006168 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.006133 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4sqgz/must-gather-hnfkk"] Jul 23 15:30:36.006638 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.006360 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="copy" containerID="cri-o://63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0" gracePeriod=2 Jul 23 15:30:36.008312 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.008278 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hnfkk\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sqgz\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="0541062e-a183-4993-bdc6-7828283c54bf" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.008572 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.008548 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4sqgz/must-gather-hnfkk"] Jul 23 15:30:36.241790 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.241764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4sqgz_must-gather-hnfkk_0541062e-a183-4993-bdc6-7828283c54bf/copy/0.log" Jul 23 15:30:36.243338 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.243323 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.245384 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.245359 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hnfkk\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sqgz\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="0541062e-a183-4993-bdc6-7828283c54bf" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.274567 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.274506 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zc5d\" (UniqueName: \"kubernetes.io/projected/0541062e-a183-4993-bdc6-7828283c54bf-kube-api-access-8zc5d\") pod \"0541062e-a183-4993-bdc6-7828283c54bf\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " Jul 23 15:30:36.274567 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.274557 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0541062e-a183-4993-bdc6-7828283c54bf-must-gather-output\") pod \"0541062e-a183-4993-bdc6-7828283c54bf\" (UID: \"0541062e-a183-4993-bdc6-7828283c54bf\") " Jul 23 15:30:36.275648 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.275618 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0541062e-a183-4993-bdc6-7828283c54bf-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "0541062e-a183-4993-bdc6-7828283c54bf" (UID: "0541062e-a183-4993-bdc6-7828283c54bf"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:30:36.276881 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.276859 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0541062e-a183-4993-bdc6-7828283c54bf-kube-api-access-8zc5d" (OuterVolumeSpecName: "kube-api-access-8zc5d") pod "0541062e-a183-4993-bdc6-7828283c54bf" (UID: "0541062e-a183-4993-bdc6-7828283c54bf"). InnerVolumeSpecName "kube-api-access-8zc5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:30:36.375952 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.375917 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zc5d\" (UniqueName: \"kubernetes.io/projected/0541062e-a183-4993-bdc6-7828283c54bf-kube-api-access-8zc5d\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:30:36.375952 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.375946 2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0541062e-a183-4993-bdc6-7828283c54bf-must-gather-output\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 23 15:30:36.402431 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.402399 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4sqgz_must-gather-hnfkk_0541062e-a183-4993-bdc6-7828283c54bf/copy/0.log" Jul 23 15:30:36.402781 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.402756 2575 generic.go:356] "Generic (PLEG): container finished" podID="0541062e-a183-4993-bdc6-7828283c54bf" containerID="63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0" exitCode=143 Jul 23 15:30:36.402861 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.402814 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.402861 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.402843 2575 scope.go:117] "RemoveContainer" containerID="63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0" Jul 23 15:30:36.405012 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.404979 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hnfkk\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sqgz\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="0541062e-a183-4993-bdc6-7828283c54bf" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.410848 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.410823 2575 scope.go:117] "RemoveContainer" containerID="5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7" Jul 23 15:30:36.412691 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.412644 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hnfkk\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sqgz\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="0541062e-a183-4993-bdc6-7828283c54bf" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.422755 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.422736 2575 scope.go:117] "RemoveContainer" containerID="63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0" Jul 23 15:30:36.423060 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.423040 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0\": container with ID starting with 63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0 not found: ID does not exist" containerID="63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0" Jul 23 15:30:36.423127 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.423074 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0"} err="failed to get container status \"63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0\": rpc error: code = NotFound desc = could not find container \"63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0\": container with ID starting with 63637c2589b5968b4f3e7fadf10a6927803a3c658470fa2501edba45e36609e0 not found: ID does not exist" Jul 23 15:30:36.423127 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.423101 2575 scope.go:117] "RemoveContainer" containerID="5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7" Jul 23 15:30:36.423395 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.423377 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7\": container with ID starting with 5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7 not found: ID does not exist" containerID="5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7" Jul 23 15:30:36.423434 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.423401 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7"} err="failed to get container status \"5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7\": rpc error: code = NotFound desc = could not find container \"5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7\": container with ID starting with 5857f0d6d8f27c89cf614b342baedda28fbe0f6069fe435349f38a7956554bf7 not found: ID does not exist" Jul 23 15:30:36.747515 ip-10-0-139-153 kubenswrapper[2575]: E0723 15:30:36.747475 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hnfkk\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4sqgz\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="0541062e-a183-4993-bdc6-7828283c54bf" pod="openshift-must-gather-4sqgz/must-gather-hnfkk" Jul 23 15:30:36.748734 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:36.748709 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0541062e-a183-4993-bdc6-7828283c54bf" path="/var/lib/kubelet/pods/0541062e-a183-4993-bdc6-7828283c54bf/volumes" Jul 23 15:30:39.093607 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.093579 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rqcx8_83d87f52-2895-4143-b871-f41f3fee17c0/kube-state-metrics/0.log" Jul 23 15:30:39.120032 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.120006 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rqcx8_83d87f52-2895-4143-b871-f41f3fee17c0/kube-rbac-proxy-main/0.log" Jul 23 15:30:39.142545 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.142515 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-rqcx8_83d87f52-2895-4143-b871-f41f3fee17c0/kube-rbac-proxy-self/0.log" Jul 23 15:30:39.202117 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.202045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-rtm96_a3e0e152-4bd3-4334-b4c6-bebd28023789/monitoring-plugin/0.log" Jul 23 15:30:39.228950 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.228919 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9pg8_3d611547-f182-4600-ae88-436b50ed0dc7/node-exporter/0.log" Jul 23 15:30:39.250233 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.250203 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9pg8_3d611547-f182-4600-ae88-436b50ed0dc7/kube-rbac-proxy/0.log" Jul 23 15:30:39.274057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.274038 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9pg8_3d611547-f182-4600-ae88-436b50ed0dc7/init-textfile/0.log" Jul 23 15:30:39.501986 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.501895 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6n9dt_d14b7d71-f269-4a91-ad62-051c422dec54/kube-rbac-proxy-main/0.log" Jul 23 15:30:39.524513 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.524482 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6n9dt_d14b7d71-f269-4a91-ad62-051c422dec54/kube-rbac-proxy-self/0.log" Jul 23 15:30:39.546884 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.546862 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6n9dt_d14b7d71-f269-4a91-ad62-051c422dec54/openshift-state-metrics/0.log" Jul 23 15:30:39.585937 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.585916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/prometheus/0.log" Jul 23 15:30:39.612321 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.612299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/config-reloader/0.log" Jul 23 15:30:39.637744 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.637717 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/thanos-sidecar/0.log" Jul 23 15:30:39.661394 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.661372 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/kube-rbac-proxy-web/0.log" Jul 23 15:30:39.697116 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.697093 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/kube-rbac-proxy/0.log" Jul 23 15:30:39.730845 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.730825 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/kube-rbac-proxy-thanos/0.log" Jul 23 15:30:39.772786 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:39.772722 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08bd213d-8f54-4ac2-9e04-7bc1d881779d/init-config-reloader/0.log" Jul 23 15:30:40.028181 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:40.028097 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bd68f9587-g68g7_00396778-bb09-43f5-8829-72052aab3e12/thanos-query/0.log" Jul 23 15:30:40.053841 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:40.053802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bd68f9587-g68g7_00396778-bb09-43f5-8829-72052aab3e12/kube-rbac-proxy-web/0.log" Jul 23 15:30:40.079057 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:40.079017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bd68f9587-g68g7_00396778-bb09-43f5-8829-72052aab3e12/kube-rbac-proxy/0.log" Jul 23 15:30:40.101273 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:40.101240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bd68f9587-g68g7_00396778-bb09-43f5-8829-72052aab3e12/prom-label-proxy/0.log" Jul 23 15:30:40.129520 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:40.129495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bd68f9587-g68g7_00396778-bb09-43f5-8829-72052aab3e12/kube-rbac-proxy-rules/0.log" Jul 23 15:30:40.154062 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:40.154037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bd68f9587-g68g7_00396778-bb09-43f5-8829-72052aab3e12/kube-rbac-proxy-metrics/0.log" Jul 23 15:30:41.952597 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952564 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5"] Jul 23 15:30:41.952994 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952868 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="gather" Jul 23 15:30:41.952994 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952878 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="gather" Jul 23 15:30:41.952994 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952889 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="copy" Jul 23 15:30:41.952994 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952896 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="copy" Jul 23 15:30:41.952994 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952943 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="gather" Jul 23 15:30:41.952994 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.952952 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0541062e-a183-4993-bdc6-7828283c54bf" containerName="copy" Jul 23 15:30:41.955870 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.955853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:41.958432 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.958404 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g97j2\"/\"kube-root-ca.crt\"" Jul 23 15:30:41.959291 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.959271 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g97j2\"/\"openshift-service-ca.crt\"" Jul 23 15:30:41.959420 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.959274 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g97j2\"/\"default-dockercfg-jvxfl\"" Jul 23 15:30:41.963762 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:41.963738 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5"] Jul 23 15:30:42.022981 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.022933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-sys\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.022981 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.022988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-proc\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.023194 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.023011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-podres\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.023194 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.023100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-lib-modules\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.023194 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.023126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zqrb\" (UniqueName: \"kubernetes.io/projected/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-kube-api-access-8zqrb\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124325 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-proc\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124405 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-podres\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124405 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-lib-modules\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124405 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zqrb\" (UniqueName: \"kubernetes.io/projected/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-kube-api-access-8zqrb\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124498 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-proc\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124498 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-sys\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124532 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-sys\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124556 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-podres\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.124621 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.124554 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-lib-modules\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.131988 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.131958 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zqrb\" (UniqueName: \"kubernetes.io/projected/65d97b70-28d1-40cf-8e4a-dbd852db0e4f-kube-api-access-8zqrb\") pod \"perf-node-gather-daemonset-sshn5\" (UID: \"65d97b70-28d1-40cf-8e4a-dbd852db0e4f\") " pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.266517 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.266431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:42.399385 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.399362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5"] Jul 23 15:30:42.401537 ip-10-0-139-153 kubenswrapper[2575]: W0723 15:30:42.401510 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod65d97b70_28d1_40cf_8e4a_dbd852db0e4f.slice/crio-0a34c97a17715fd968fc72a2d186876639569de3a3c2c610aeecb5cd936f90bc WatchSource:0}: Error finding container 0a34c97a17715fd968fc72a2d186876639569de3a3c2c610aeecb5cd936f90bc: Status 404 returned error can't find the container with id 0a34c97a17715fd968fc72a2d186876639569de3a3c2c610aeecb5cd936f90bc Jul 23 15:30:42.425883 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:42.425858 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" event={"ID":"65d97b70-28d1-40cf-8e4a-dbd852db0e4f","Type":"ContainerStarted","Data":"0a34c97a17715fd968fc72a2d186876639569de3a3c2c610aeecb5cd936f90bc"} Jul 23 15:30:43.430575 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:43.430544 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" event={"ID":"65d97b70-28d1-40cf-8e4a-dbd852db0e4f","Type":"ContainerStarted","Data":"0b9b6f3c9ff34bfa89061424259cfd0dd7a6c6b6360b867f44207e50268baab4"} Jul 23 15:30:43.431067 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:43.430652 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:43.446541 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:43.446491 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" podStartSLOduration=2.446476074 podStartE2EDuration="2.446476074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:30:43.446128277 +0000 UTC m=+657.293781833" watchObservedRunningTime="2026-07-23 15:30:43.446476074 +0000 UTC m=+657.294129618" Jul 23 15:30:43.521544 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:43.521514 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwr9s_a3d85d1d-3282-43c2-a96a-87cef82e05fb/dns/0.log" Jul 23 15:30:43.542573 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:43.542543 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwr9s_a3d85d1d-3282-43c2-a96a-87cef82e05fb/kube-rbac-proxy/0.log" Jul 23 15:30:43.637927 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:43.637897 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5w4hz_1fbeac19-89df-4864-95dc-50fb0d8f3bcf/dns-node-resolver/0.log" Jul 23 15:30:44.098174 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:44.098148 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66f99d5d7f-9rbm7_c1e7c335-cfe2-4a27-84ef-375626788078/registry/0.log" Jul 23 15:30:44.149775 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:44.149753 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nwmt2_184ad1d7-7c16-42f1-a343-257633bf464e/node-ca/0.log" Jul 23 15:30:45.282363 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:45.282324 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4pnvw_4c166ed8-d71e-4e63-888f-1c7dabe257c2/serve-healthcheck-canary/0.log" Jul 23 15:30:45.787421 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:45.787393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lzq7n_e2f6e626-b322-49aa-9be6-1a4b72e1a6a9/kube-rbac-proxy/0.log" Jul 23 15:30:45.815259 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:45.815232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lzq7n_e2f6e626-b322-49aa-9be6-1a4b72e1a6a9/exporter/0.log" Jul 23 15:30:45.841278 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:45.841250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lzq7n_e2f6e626-b322-49aa-9be6-1a4b72e1a6a9/extractor/0.log" Jul 23 15:30:47.666612 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:47.666581 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-pddbw_f0343603-155e-48fa-9213-c8c1148ec8f9/jobset-operator/0.log" Jul 23 15:30:49.444036 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:49.444005 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g97j2/perf-node-gather-daemonset-sshn5" Jul 23 15:30:52.347379 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.347348 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/kube-multus-additional-cni-plugins/0.log" Jul 23 15:30:52.390219 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.390192 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/egress-router-binary-copy/0.log" Jul 23 15:30:52.449856 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.449836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/cni-plugins/0.log" Jul 23 15:30:52.474362 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.474298 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/bond-cni-plugin/0.log" Jul 23 15:30:52.501188 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.501163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/routeoverride-cni/0.log" Jul 23 15:30:52.527263 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.527239 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/whereabouts-cni-bincopy/0.log" Jul 23 15:30:52.550976 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:52.550952 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68gmr_1e66636f-6c89-4bab-9536-cd542ab96d9c/whereabouts-cni/0.log" Jul 23 15:30:53.001509 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:53.001481 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ntjrj_2a920ee6-145f-415e-b8ec-6a7646245184/kube-multus/0.log" Jul 23 15:30:53.141690 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:53.141595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l5j82_4359259a-6b2e-445c-aee7-db07a6bb35d9/network-metrics-daemon/0.log" Jul 23 15:30:53.162602 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:53.162571 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l5j82_4359259a-6b2e-445c-aee7-db07a6bb35d9/kube-rbac-proxy/0.log" Jul 23 15:30:54.216700 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.216676 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-controller/0.log" Jul 23 15:30:54.245642 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.245610 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/1.log" Jul 23 15:30:54.245814 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.245714 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovn-acl-logging/0.log" Jul 23 15:30:54.263163 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.263140 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/kube-rbac-proxy-node/0.log" Jul 23 15:30:54.286451 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.286419 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 15:30:54.307416 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.307387 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/northd/0.log" Jul 23 15:30:54.334445 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.334401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/nbdb/0.log" Jul 23 15:30:54.365696 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.365670 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/sbdb/0.log" Jul 23 15:30:54.413599 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:54.413568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxn8b_56595aba-438b-4c13-87b1-f258016eab45/ovnkube-controller/0.log" Jul 23 15:30:55.752739 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:55.752705 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hf4mp_100e2e9e-41a8-461c-88fa-4012f2ba4a6f/network-check-target-container/0.log" Jul 23 15:30:56.803999 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:56.803969 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mqxch_b37a0c87-f595-452a-8820-8d378af36635/iptables-alerter/0.log" Jul 23 15:30:57.512342 ip-10-0-139-153 kubenswrapper[2575]: I0723 15:30:57.512313 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rmmzt_127a051e-ed78-4bd4-9d27-5279a89cfd1d/tuned/0.log"