Jul 27 09:48:27.559020 ip-10-0-134-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 09:48:27.559033 ip-10-0-134-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 09:48:27.559042 ip-10-0-134-146 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 09:48:27.559357 ip-10-0-134-146 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 09:48:37.034711 ip-10-0-134-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 27 09:48:37.034724 ip-10-0-134-146 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0a3ba65538ae4293a781d58a58bdc55e -- Jul 27 09:50:26.223066 ip-10-0-134-146 systemd[1]: Starting Kubernetes Kubelet... Jul 27 09:50:26.594171 ip-10-0-134-146 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:50:26.594171 ip-10-0-134-146 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 09:50:26.594171 ip-10-0-134-146 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:50:26.594171 ip-10-0-134-146 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 09:50:26.594171 ip-10-0-134-146 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:50:26.595860 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.595659 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 09:50:26.601628 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601606 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:26.601628 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601624 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:26.601628 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601628 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:26.601628 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601631 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:26.601628 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601634 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601638 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601641 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601644 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601647 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601653 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601656 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601659 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601662 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601665 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601668 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601671 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601673 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601676 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601680 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601683 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601686 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601688 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601693 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601696 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:26.601816 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601699 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601702 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601705 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601708 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601711 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601714 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601717 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601719 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601722 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601725 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601730 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601733 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601735 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601738 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601758 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601761 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601765 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601768 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601771 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601773 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:26.602289 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601776 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601779 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601781 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601789 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601795 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601799 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601802 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601805 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601809 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601813 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601816 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601820 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601823 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601826 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601832 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601835 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601838 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601841 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601844 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:26.602783 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601846 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601849 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601852 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601854 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601857 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601861 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601864 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601870 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601873 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601876 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601879 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601882 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601885 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601887 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601890 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601893 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601895 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601898 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601901 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601906 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:26.603238 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601908 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601911 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601914 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601916 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601919 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601922 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601924 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601927 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601929 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601932 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601936 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601939 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601945 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601948 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601951 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.601954 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603086 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603093 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603097 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:26.603756 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603101 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603105 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603108 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603110 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603113 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603116 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603119 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603124 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603128 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603130 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603133 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603136 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603138 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603141 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603144 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603146 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603149 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603151 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603154 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603157 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:26.604213 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603164 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603167 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603170 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603173 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603176 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603179 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603182 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603185 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603187 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603190 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603193 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603196 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603202 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603204 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603208 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603210 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603213 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603215 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603218 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603221 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:26.604726 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603223 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603226 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603228 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603231 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603235 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603242 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603245 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603247 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603250 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603252 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603255 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603258 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603260 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603263 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603266 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603269 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603271 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603276 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603280 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:26.605257 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603283 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603285 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603288 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603291 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603294 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603298 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603300 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603303 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603663 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603666 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603672 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603674 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603677 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603680 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603683 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603687 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603689 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603692 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603695 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603697 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:26.605728 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603700 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603706 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603709 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603711 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603714 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603717 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603719 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603722 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603724 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603727 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603730 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603732 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603735 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603740 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603755 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603758 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.603762 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604347 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604352 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604355 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:26.606235 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604358 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604361 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604363 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604366 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604368 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604371 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604376 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604379 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604382 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604384 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604387 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604390 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604392 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604395 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604399 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604401 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604404 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604407 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604412 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:26.606715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604415 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604417 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604420 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604423 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604426 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604428 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604431 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604433 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604436 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604440 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604443 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604445 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604450 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604453 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604457 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604459 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604462 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604465 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604467 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604470 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:26.607182 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604473 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604475 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604478 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604480 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604485 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604488 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604491 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604493 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604496 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604498 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604501 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604505 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604509 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604512 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604514 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604517 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604522 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604525 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604528 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604531 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:26.607671 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604534 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604539 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604543 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604546 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604549 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604552 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604555 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604560 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604563 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604566 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604569 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604571 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604574 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604576 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604579 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604582 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604585 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604587 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604590 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604592 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:26.608173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604597 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604600 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604602 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604605 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604607 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604610 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604613 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604617 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604622 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604626 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604630 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604634 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604641 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604646 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604651 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604655 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.604659 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604924 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604946 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604955 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604960 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 09:50:26.608680 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604964 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604967 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604980 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604984 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604987 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604990 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604994 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.604997 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605000 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605003 2581 flags.go:64] FLAG: --cgroup-root="" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605006 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605009 2581 flags.go:64] FLAG: --client-ca-file="" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605014 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605018 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605026 2581 flags.go:64] FLAG: --cluster-domain="" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605031 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605034 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605037 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605040 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605044 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605048 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605051 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605054 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605057 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 27 09:50:26.609204 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605060 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605063 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605066 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605068 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605073 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605076 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605079 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605083 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605086 2581 flags.go:64] FLAG: --enable-server="true" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605089 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605095 2581 flags.go:64] FLAG: --event-burst="100" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605100 2581 flags.go:64] FLAG: --event-qps="50" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605104 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605109 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605114 2581 flags.go:64] FLAG: --eviction-hard="" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605118 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605121 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605124 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605127 2581 flags.go:64] FLAG: --eviction-soft="" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605130 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605133 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605137 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605139 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605142 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605145 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 09:50:26.609807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605148 2581 flags.go:64] FLAG: --feature-gates="" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605151 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605154 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605157 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605160 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605163 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605166 2581 flags.go:64] FLAG: --help="false" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605169 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605171 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605174 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605177 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605184 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605191 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605196 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605200 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605202 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605205 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605208 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605211 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605214 2581 flags.go:64] FLAG: --kube-reserved="" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605217 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605219 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605222 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605225 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 09:50:26.610416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605228 2581 flags.go:64] FLAG: --lock-file="" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605230 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605233 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605236 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605242 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605246 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605248 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605251 2581 flags.go:64] FLAG: --logging-format="text" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605254 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605258 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605264 2581 flags.go:64] FLAG: --manifest-url="" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605269 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605276 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605279 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605283 2581 flags.go:64] FLAG: --max-pods="110" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605286 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605289 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605291 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605294 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605297 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605300 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605303 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605311 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605314 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605317 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 09:50:26.611004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605320 2581 flags.go:64] FLAG: --pod-cidr="" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605323 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605329 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605332 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605335 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605338 2581 flags.go:64] FLAG: --port="10250" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605343 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605348 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ceda96e2784bbbef" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605353 2581 flags.go:64] FLAG: --qos-reserved="" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605357 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605360 2581 flags.go:64] FLAG: --register-node="true" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605363 2581 flags.go:64] FLAG: --register-with-taints="" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605367 2581 flags.go:64] FLAG: --registry-burst="10" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605370 2581 flags.go:64] FLAG: --registry-qps="5" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605373 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605376 2581 flags.go:64] FLAG: --reserved-memory="" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605379 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605382 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605386 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605388 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605391 2581 flags.go:64] FLAG: --runonce="false" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605394 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605397 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605400 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605402 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 09:50:26.611625 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605405 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605408 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605411 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605414 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605416 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605422 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605426 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605431 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605436 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605439 2581 flags.go:64] FLAG: --system-cgroups="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605441 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605448 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605450 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605453 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605457 2581 flags.go:64] FLAG: --tls-min-version="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605460 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605462 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605465 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605470 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605472 2581 flags.go:64] FLAG: --v="2" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605476 2581 flags.go:64] FLAG: --version="false" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605481 2581 flags.go:64] FLAG: --vmodule="" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605485 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.605488 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605627 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:26.612404 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605633 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605637 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605641 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605645 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605648 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605650 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605653 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605656 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605661 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605666 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605670 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605674 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605677 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605679 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605682 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605684 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605687 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605689 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605692 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:26.613019 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605694 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605697 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605699 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605702 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605704 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605708 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605712 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605715 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605718 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605720 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605723 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605726 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605728 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605734 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605737 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605758 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605763 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605767 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605770 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605772 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:26.613475 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605775 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605778 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605780 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605782 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605785 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605787 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605790 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605792 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605795 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605797 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605800 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605802 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605804 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605807 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605809 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605812 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605814 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605817 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605821 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605824 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:26.613997 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605827 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605831 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605835 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605840 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605845 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605849 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605851 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605854 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605856 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605859 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605861 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605864 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605866 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605869 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605871 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605873 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605878 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605881 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605884 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:26.614473 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605887 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605889 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605892 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605894 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605897 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605900 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605902 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605905 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605908 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605912 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605916 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605922 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605927 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605929 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605932 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605934 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605936 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605940 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605944 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:26.614978 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.605947 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.606683 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.613372 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.613387 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.613406 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.613412 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613466 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613471 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613474 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613478 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613481 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613484 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613487 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613490 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:26.615436 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613494 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613497 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613500 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613502 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613505 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613507 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613510 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613513 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613515 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613518 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613520 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613523 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613525 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613528 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613530 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613533 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613535 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613538 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613540 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:26.615791 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613543 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613545 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613549 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613552 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613564 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613566 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613569 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613571 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613574 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613577 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613579 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613582 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613584 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613587 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613589 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613592 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613594 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613596 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613599 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613602 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:26.616322 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613604 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613606 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613609 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613611 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613615 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613618 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613622 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613625 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613627 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613630 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613633 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613635 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613637 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613640 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613643 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613646 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613649 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613651 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613653 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:26.616976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613656 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613659 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613661 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613664 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613667 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613670 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613674 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613677 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613680 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613683 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613686 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613688 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613691 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613693 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613696 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613698 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613701 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613703 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613706 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:26.617462 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613709 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613712 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613714 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613717 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613719 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613722 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613725 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613727 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613730 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613732 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613736 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613738 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613740 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613759 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.613765 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613873 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:50:26.617976 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613878 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613881 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613884 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613886 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613889 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613891 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613894 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613896 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613899 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613901 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613904 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613906 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613909 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613911 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613913 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613916 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613919 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613921 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613924 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613926 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:50:26.618368 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613929 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613931 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613934 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613936 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613939 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613941 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613944 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613947 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613950 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613952 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613955 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613957 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613960 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613962 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613964 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613967 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613969 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613972 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613974 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613976 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:50:26.618873 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613979 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613981 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613983 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613985 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613988 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613990 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613994 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.613997 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614001 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614003 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614006 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614008 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614011 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614013 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614016 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614018 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614021 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614024 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614026 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:50:26.619353 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614029 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614033 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614036 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614038 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614041 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614044 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614048 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614050 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614053 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614056 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614059 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614061 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614064 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614067 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614070 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614072 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614075 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614078 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614080 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:50:26.619831 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614083 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614086 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614089 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614092 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614094 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614097 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614099 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614102 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614104 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614107 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614110 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614112 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614115 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614117 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614120 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614123 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614126 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614128 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614131 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:50:26.620314 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:26.614133 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.614138 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.614235 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.616146 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.617642 2581 server.go:1019] "Starting client certificate rotation" Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.617757 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.617793 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 09:50:26.620846 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.620137 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 09:50:26.621667 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.621648 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 09:50:26.634015 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.633996 2581 log.go:25] "Validated CRI v1 runtime API" Jul 27 09:50:26.635856 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.635843 2581 log.go:25] "Validated CRI v1 image API" Jul 27 09:50:26.636600 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.636582 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 09:50:26.639288 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.639269 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8a35ac4b-12ac-497d-ac86-aa993eea5b4a:/dev/nvme0n1p4 ddc42c45-7d69-490d-95d2-19db288c9453:/dev/nvme0n1p3] Jul 27 09:50:26.639366 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.639287 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 09:50:26.646181 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.646038 2581 manager.go:216] Machine: {Timestamp:2026-07-27 09:50:26.644592356 +0000 UTC m=+0.304578174 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103633 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258b40d366d4bf69d388a027c429f7 SystemUUID:ec258b40-d366-d4bf-69d3-88a027c429f7 BootID:0a3ba655-38ae-4293-a781-d58a58bdc55e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:c4:4e:63:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:c4:4e:63:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:6e:53:4f:57:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 09:50:26.646181 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.646168 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 09:50:26.646374 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.646272 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 09:50:26.649493 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.649466 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 09:50:26.649658 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.649496 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 09:50:26.649855 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.649839 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 09:50:26.650697 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.650683 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 09:50:26.650768 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.650704 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 09:50:26.650768 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.650714 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 09:50:26.651518 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.651506 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 09:50:26.652297 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.652285 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 09:50:26.653946 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.653932 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 27 09:50:26.654086 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654075 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 09:50:26.654148 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654112 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 27 09:50:26.654148 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654127 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 09:50:26.654148 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654145 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 09:50:26.654269 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654159 2581 kubelet.go:398] "Adding apiserver pod source" Jul 27 09:50:26.654269 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654172 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 09:50:26.654535 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654521 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 09:50:26.654608 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.654543 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 09:50:26.656721 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.656706 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 09:50:26.658642 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.658629 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 09:50:26.658700 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.658660 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 09:50:26.660177 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660167 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 09:50:26.660214 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660183 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 09:50:26.660214 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660196 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 09:50:26.660214 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660203 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 09:50:26.660214 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660211 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660217 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660225 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660232 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660238 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660243 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660259 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 09:50:26.660320 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.660265 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 09:50:26.661567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.661551 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 09:50:26.661567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.661567 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 09:50:26.664483 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.664463 2581 server.go:1268] "Started kubelet" Jul 27 09:50:26.664589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.664566 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 09:50:26.664650 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.664561 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 09:50:26.664701 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.664663 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 09:50:26.665352 ip-10-0-134-146 systemd[1]: Started Kubernetes Kubelet. Jul 27 09:50:26.666311 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.666295 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 09:50:26.666686 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.666657 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 09:50:26.666789 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.666690 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 09:50:26.666789 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.666685 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 09:50:26.667134 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.667116 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 27 09:50:26.672413 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.669794 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-146.ec2.internal.18c61cabd69adc7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-146.ec2.internal,UID:ip-10-0-134-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-146.ec2.internal,},FirstTimestamp:2026-07-27 09:50:26.664438909 +0000 UTC m=+0.324424727,LastTimestamp:2026-07-27 09:50:26.664438909 +0000 UTC m=+0.324424727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-146.ec2.internal,}" Jul 27 09:50:26.672871 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.672827 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 09:50:26.673617 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.673601 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 09:50:26.673765 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.673695 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 09:50:26.673910 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.673887 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:26.674554 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.674441 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 09:50:26.675005 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.674686 2581 factory.go:55] Registering systemd factory Jul 27 09:50:26.675005 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.674702 2581 factory.go:223] Registration of the systemd container factory successfully Jul 27 09:50:26.675149 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675135 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 09:50:26.675221 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675209 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 09:50:26.675287 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675273 2581 factory.go:153] Registering CRI-O factory Jul 27 09:50:26.675586 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675565 2581 factory.go:223] Registration of the crio container factory successfully Jul 27 09:50:26.675663 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675589 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 27 09:50:26.675663 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675599 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 27 09:50:26.675663 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675647 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 09:50:26.675774 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675671 2581 factory.go:103] Registering Raw factory Jul 27 09:50:26.675774 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.675684 2581 manager.go:1196] Started watching for new ooms in manager Jul 27 09:50:26.676142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.676126 2581 manager.go:349] Starting recovery of all containers Jul 27 09:50:26.676991 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.676957 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 09:50:26.677096 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.677074 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 09:50:26.678503 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.678480 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rmpbf" Jul 27 09:50:26.684470 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.684454 2581 manager.go:354] Recovery completed Jul 27 09:50:26.687263 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.687245 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rmpbf" Jul 27 09:50:26.688735 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.688720 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.691973 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.691958 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.692046 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.691992 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.692046 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.692005 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.692547 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.692535 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 09:50:26.692547 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.692547 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.692672 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.692547 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 09:50:26.692672 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.692618 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 27 09:50:26.693223 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.693208 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.693286 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.693233 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.693286 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.693247 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.694061 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.694048 2581 policy_none.go:49] "None policy: Start" Jul 27 09:50:26.694100 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.694064 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 09:50:26.694100 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.694075 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 09:50:26.694939 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.694925 2581 policy_none.go:47] "Start" Jul 27 09:50:26.694993 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.694885 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-146.ec2.internal.18c61cabd83f0b42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-146.ec2.internal,UID:ip-10-0-134-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-146.ec2.internal,},FirstTimestamp:2026-07-27 09:50:26.691976002 +0000 UTC m=+0.351961823,LastTimestamp:2026-07-27 09:50:26.691976002 +0000 UTC m=+0.351961823,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-146.ec2.internal,}" Jul 27 09:50:26.730435 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730293 2581 manager.go:337] "Starting Device Plugin manager" Jul 27 09:50:26.730503 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.730458 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 09:50:26.730503 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730472 2581 server.go:87] "Starting device plugin registration server" Jul 27 09:50:26.730716 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730704 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 09:50:26.730795 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730718 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 09:50:26.730890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730873 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 09:50:26.730998 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730983 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 09:50:26.730998 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.730997 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 09:50:26.731363 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.731343 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 09:50:26.731432 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.731395 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:26.808829 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.808806 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 09:50:26.810781 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.810091 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 09:50:26.810781 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.810133 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 09:50:26.810781 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.810155 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 09:50:26.810781 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.810192 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 09:50:26.813262 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.813248 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:26.831699 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.831686 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.832487 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.832470 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.832571 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.832505 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.832571 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.832520 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.832571 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.832548 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.841851 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.841833 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.841913 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.841853 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-146.ec2.internal\": node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:26.854967 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.854926 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:26.910861 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.910831 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal"] Jul 27 09:50:26.910987 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.910895 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.912444 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.912428 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.912540 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.912485 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.912540 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.912500 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.914621 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.914609 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.914779 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.914766 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.914819 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.914794 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.915421 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.915407 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.915510 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.915439 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.915510 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.915453 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.915510 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.915407 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.915651 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.915513 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.915651 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.915525 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.917601 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.917585 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.917663 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.917612 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:50:26.918341 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.918327 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:50:26.918416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.918352 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:50:26.918416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.918367 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:50:26.940358 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.940336 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-146.ec2.internal\" not found" node="ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.944784 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.944765 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-146.ec2.internal\" not found" node="ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.955752 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:26.955732 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:26.976916 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.976891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6591fe7dee8ebf5f58ccb667914ec553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal\" (UID: \"6591fe7dee8ebf5f58ccb667914ec553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.977019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.976919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6591fe7dee8ebf5f58ccb667914ec553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal\" (UID: \"6591fe7dee8ebf5f58ccb667914ec553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:26.977019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:26.976937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fd77e6fdc961fb201c2b3fe02df46d9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-146.ec2.internal\" (UID: \"1fd77e6fdc961fb201c2b3fe02df46d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.056825 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.056801 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:27.077179 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.077153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6591fe7dee8ebf5f58ccb667914ec553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal\" (UID: \"6591fe7dee8ebf5f58ccb667914ec553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.077274 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.077180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6591fe7dee8ebf5f58ccb667914ec553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal\" (UID: \"6591fe7dee8ebf5f58ccb667914ec553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.077274 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.077199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fd77e6fdc961fb201c2b3fe02df46d9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-146.ec2.internal\" (UID: \"1fd77e6fdc961fb201c2b3fe02df46d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.077274 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.077242 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6591fe7dee8ebf5f58ccb667914ec553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal\" (UID: \"6591fe7dee8ebf5f58ccb667914ec553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.077274 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.077249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6591fe7dee8ebf5f58ccb667914ec553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal\" (UID: \"6591fe7dee8ebf5f58ccb667914ec553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.077414 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.077280 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fd77e6fdc961fb201c2b3fe02df46d9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-146.ec2.internal\" (UID: \"1fd77e6fdc961fb201c2b3fe02df46d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.157568 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.157484 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:27.243031 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.242993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.248106 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.247969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.258157 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.258139 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:27.358721 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.358685 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:27.459208 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.459148 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:27.559711 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.559686 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-146.ec2.internal\" not found" Jul 27 09:50:27.565916 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.565902 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:27.574654 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.574640 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.586084 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.586068 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 09:50:27.587853 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.587841 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" Jul 27 09:50:27.596966 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.596951 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 09:50:27.617068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.617046 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 09:50:27.617166 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.617149 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 09:50:27.617212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.617188 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 09:50:27.654709 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.654694 2581 apiserver.go:52] "Watching apiserver" Jul 27 09:50:27.669624 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.669608 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:27.673906 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.673893 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 09:50:27.674035 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.673896 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 09:50:27.674173 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.674156 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pftg2","openshift-ovn-kubernetes/ovnkube-node-gpnc8","kube-system/global-pull-secret-syncer-46qr2","kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kqzbv","openshift-multus/multus-additional-cni-plugins-f2s5j","openshift-multus/multus-k9q22","openshift-multus/network-metrics-daemon-zvq9q","kube-system/konnectivity-agent-q7t68","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg","openshift-dns/node-resolver-cmfkm","openshift-image-registry/node-ca-5c5xt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal","openshift-network-diagnostics/network-check-target-gx68r"] Jul 27 09:50:27.676439 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.676427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.678480 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.678465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.678881 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.678867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 09:50:27.679260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.679246 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5g6h\"" Jul 27 09:50:27.680057 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680046 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.680346 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680327 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.680431 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.680856 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-etc-selinux\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.680958 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-sys-fs\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.680958 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkf8\" (UniqueName: \"kubernetes.io/projected/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-kube-api-access-2dkf8\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.680958 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.680932 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:27.681098 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.681098 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680986 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.681098 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.681033 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.681289 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.680989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-socket-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.681348 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.681327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-registration-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.681396 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.681380 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5xwzb\"" Jul 27 09:50:27.681561 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.681538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-device-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.683106 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.682801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:27.683106 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.682914 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:27.685143 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.685126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.687135 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.687118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.687511 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.687494 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2hjb\"" Jul 27 09:50:27.687587 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.687555 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.687587 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.687576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.689165 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.689148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.689514 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.689499 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.689514 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.689513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qtkn9\"" Jul 27 09:50:27.689635 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.689574 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 09:50:27.689802 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.689787 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 09:50:27.690546 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.690528 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.690633 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.690542 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 09:45:26 +0000 UTC" deadline="2028-02-22 01:40:08.656050512 +0000 UTC" Jul 27 09:50:27.690633 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.690570 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13791h49m40.965482657s" Jul 27 09:50:27.691346 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.691329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:27.691432 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.691413 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:27.691623 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.691609 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 09:50:27.691688 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.691667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6dgrx\"" Jul 27 09:50:27.691893 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.691881 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 09:50:27.692313 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.692297 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 09:50:27.693637 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.693621 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.695950 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.695933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.697343 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.697326 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 09:50:27.697463 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.697364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 09:50:27.697463 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.697368 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.698362 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.698345 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.698588 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.698570 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 09:50:27.699059 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.698927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cx4zk\"" Jul 27 09:50:27.699059 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.698944 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 09:50:27.699059 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.698965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 09:50:27.699059 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.699027 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.699059 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.699040 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.699323 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.699105 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.699323 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.699216 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-glrxm\"" Jul 27 09:50:27.699323 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.699233 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 09:50:27.701310 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.700716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.704542 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.704526 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 09:50:27.706536 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.706519 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 09:50:27.706631 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.706551 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rddqg\"" Jul 27 09:50:27.706759 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.706735 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-28tct\"" Jul 27 09:50:27.706820 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.706803 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 09:50:27.707436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.707419 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 09:50:27.734855 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.734841 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5r5kx" Jul 27 09:50:27.746791 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.746774 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5r5kx" Jul 27 09:50:27.775665 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.775644 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 09:50:27.781985 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.781965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-host-slash\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.782099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.781988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42pnd\" (UniqueName: \"kubernetes.io/projected/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-kube-api-access-42pnd\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.782099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysctl-d\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.782099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysctl-conf\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.782099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8msj\" (UniqueName: \"kubernetes.io/projected/37348a96-beac-4faf-8b6c-9538242b3ea5-kube-api-access-z8msj\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.782099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-daemon-config\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.782099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-cnibin\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-cni-bin\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gfnq\" (UniqueName: \"kubernetes.io/projected/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-kube-api-access-9gfnq\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-etc-selinux\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-sys\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8fdc7bf-b311-4e60-a5a1-bd30d1a97367-konnectivity-ca\") pod \"konnectivity-agent-q7t68\" (UID: \"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367\") " pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-cnibin\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-kubelet\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782268 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-etc-selinux\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782281 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-tmp-dir\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f030b68-47a0-4e5d-9776-3499c80fb0a6-dbus\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.782335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-modprobe-d\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-log-socket\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-ovnkube-config\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-env-overrides\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-socket-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-sys-fs\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkf8\" (UniqueName: \"kubernetes.io/projected/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-kube-api-access-2dkf8\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782479 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-sys-fs\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4dh\" (UniqueName: \"kubernetes.io/projected/b6db3599-f13b-41f9-9bcb-692774d28e10-kube-api-access-5s4dh\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-var-lib-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee987323-9763-4df4-b1f4-6968732f2018-ovn-node-metrics-cert\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-socket-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-var-lib-kubelet\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.782890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-host\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37348a96-beac-4faf-8b6c-9538242b3ea5-tmp\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-cni-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0463c002-a8e0-4385-90d4-fb04d302c0be-host\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-os-release\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-netns\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0463c002-a8e0-4385-90d4-fb04d302c0be-serviceca\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-cni-binary-copy\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-k8s-cni-cncf-io\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-cni-multus\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-systemd\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-registration-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-node-log\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-ovnkube-script-lib\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.783594 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-registration-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-tuned\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-system-cni-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9svw\" (UniqueName: \"kubernetes.io/projected/0463c002-a8e0-4385-90d4-fb04d302c0be-kube-api-access-k9svw\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-system-cni-dir\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.782998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-systemd-units\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-iptables-alerter-script\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-os-release\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-etc-kubernetes\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-hosts-file\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-kubelet\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-slash\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czqfr\" (UniqueName: \"kubernetes.io/projected/ee987323-9763-4df4-b1f4-6968732f2018-kube-api-access-czqfr\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-lib-modules\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.784142 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-hostroot\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-cni-netd\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-systemd\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-run\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-socket-dir-parent\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-run-netns\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysconfig\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-multus-certs\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-ovn\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f030b68-47a0-4e5d-9776-3499c80fb0a6-kubelet-config\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-device-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-kubernetes\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8fdc7bf-b311-4e60-a5a1-bd30d1a97367-agent-certs\") pod \"konnectivity-agent-q7t68\" (UID: \"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367\") " pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kptj6\" (UniqueName: \"kubernetes.io/projected/1074877b-bab2-488a-abf4-d59c2f1cf771-kube-api-access-kptj6\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.784567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-etc-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.785019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-device-dir\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.785019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-cni-bin\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.785019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-conf-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.785019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.783720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk979\" (UniqueName: \"kubernetes.io/projected/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-kube-api-access-tk979\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.790169 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.790148 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 09:50:27.793306 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.793291 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkf8\" (UniqueName: \"kubernetes.io/projected/ba0daa6d-fc5b-4f5f-a025-14b08693ad93-kube-api-access-2dkf8\") pod \"aws-ebs-csi-driver-node-lstxg\" (UID: \"ba0daa6d-fc5b-4f5f-a025-14b08693ad93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:27.884825 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-lib-modules\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.884825 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-hostroot\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-cni-netd\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884909 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-hostroot\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-lib-modules\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884956 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-cni-netd\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-systemd\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.884993 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.884995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-run\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-socket-dir-parent\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-systemd\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-run-netns\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysconfig\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-multus-certs\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-run\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-ovn\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-socket-dir-parent\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f030b68-47a0-4e5d-9776-3499c80fb0a6-kubelet-config\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-run-netns\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-ovn\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysconfig\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-kubernetes\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885161 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f030b68-47a0-4e5d-9776-3499c80fb0a6-kubelet-config\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-multus-certs\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8fdc7bf-b311-4e60-a5a1-bd30d1a97367-agent-certs\") pod \"konnectivity-agent-q7t68\" (UID: \"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367\") " pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.885242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-kubernetes\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kptj6\" (UniqueName: \"kubernetes.io/projected/1074877b-bab2-488a-abf4-d59c2f1cf771-kube-api-access-kptj6\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-etc-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-cni-bin\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-conf-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk979\" (UniqueName: \"kubernetes.io/projected/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-kube-api-access-tk979\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-etc-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-host-slash\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885281 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-cni-bin\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-host-slash\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-conf-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42pnd\" (UniqueName: \"kubernetes.io/projected/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-kube-api-access-42pnd\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysctl-d\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysctl-conf\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8msj\" (UniqueName: \"kubernetes.io/projected/37348a96-beac-4faf-8b6c-9538242b3ea5-kube-api-access-z8msj\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-daemon-config\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysctl-d\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-sysctl-conf\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-cnibin\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-cni-bin\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gfnq\" (UniqueName: \"kubernetes.io/projected/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-kube-api-access-9gfnq\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-cnibin\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.885679 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.885690 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-sys\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8fdc7bf-b311-4e60-a5a1-bd30d1a97367-konnectivity-ca\") pod \"konnectivity-agent-q7t68\" (UID: \"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367\") " pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-sys\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885648 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-cni-bin\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.885884 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:28.385728925 +0000 UTC m=+2.045714732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.885929 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:28.38591125 +0000 UTC m=+2.045897059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-cnibin\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.885985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-kubelet\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.886762 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-tmp-dir\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f030b68-47a0-4e5d-9776-3499c80fb0a6-dbus\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-modprobe-d\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-kubelet\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-log-socket\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-ovnkube-config\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-cnibin\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-env-overrides\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-daemon-config\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4dh\" (UniqueName: \"kubernetes.io/projected/b6db3599-f13b-41f9-9bcb-692774d28e10-kube-api-access-5s4dh\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-modprobe-d\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-log-socket\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-var-lib-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-var-lib-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee987323-9763-4df4-b1f4-6968732f2018-ovn-node-metrics-cert\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8fdc7bf-b311-4e60-a5a1-bd30d1a97367-konnectivity-ca\") pod \"konnectivity-agent-q7t68\" (UID: \"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367\") " pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.887488 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-tmp-dir\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886318 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-openvswitch\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-var-lib-kubelet\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886383 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f030b68-47a0-4e5d-9776-3499c80fb0a6-dbus\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-host\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-host\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37348a96-beac-4faf-8b6c-9538242b3ea5-var-lib-kubelet\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37348a96-beac-4faf-8b6c-9538242b3ea5-tmp\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-cni-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0463c002-a8e0-4385-90d4-fb04d302c0be-host\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-os-release\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-multus-cni-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-netns\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-env-overrides\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-os-release\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886648 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0463c002-a8e0-4385-90d4-fb04d302c0be-host\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.888212 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0463c002-a8e0-4385-90d4-fb04d302c0be-serviceca\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886681 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-netns\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-cni-binary-copy\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-k8s-cni-cncf-io\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-cni-multus\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-systemd\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-node-log\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-ovnkube-script-lib\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-tuned\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-system-cni-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9svw\" (UniqueName: \"kubernetes.io/projected/0463c002-a8e0-4385-90d4-fb04d302c0be-kube-api-access-k9svw\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-system-cni-dir\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-systemd-units\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.886988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-iptables-alerter-script\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.888840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-os-release\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-etc-kubernetes\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887066 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-ovnkube-config\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-hosts-file\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887124 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-hosts-file\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-kubelet\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0463c002-a8e0-4385-90d4-fb04d302c0be-serviceca\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-kubelet\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-slash\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-run-k8s-cni-cncf-io\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czqfr\" (UniqueName: \"kubernetes.io/projected/ee987323-9763-4df4-b1f4-6968732f2018-kube-api-access-czqfr\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-system-cni-dir\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887282 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-system-cni-dir\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-host-var-lib-cni-multus\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1074877b-bab2-488a-abf4-d59c2f1cf771-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887397 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-slash\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-os-release\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-cni-binary-copy\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-node-log\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-systemd-units\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1074877b-bab2-488a-abf4-d59c2f1cf771-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-host-run-ovn-kubernetes\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee987323-9763-4df4-b1f4-6968732f2018-run-systemd\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887760 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-etc-kubernetes\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee987323-9763-4df4-b1f4-6968732f2018-ovnkube-script-lib\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.887960 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-iptables-alerter-script\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.888254 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8fdc7bf-b311-4e60-a5a1-bd30d1a97367-agent-certs\") pod \"konnectivity-agent-q7t68\" (UID: \"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367\") " pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.888603 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee987323-9763-4df4-b1f4-6968732f2018-ovn-node-metrics-cert\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.889467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37348a96-beac-4faf-8b6c-9538242b3ea5-etc-tuned\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.889813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.889772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37348a96-beac-4faf-8b6c-9538242b3ea5-tmp\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.896622 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.896599 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:27.896801 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.896628 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:27.896801 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.896682 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:27.896801 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:27.896760 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:28.396723063 +0000 UTC m=+2.056708869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:27.897655 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.897259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8msj\" (UniqueName: \"kubernetes.io/projected/37348a96-beac-4faf-8b6c-9538242b3ea5-kube-api-access-z8msj\") pod \"tuned-kqzbv\" (UID: \"37348a96-beac-4faf-8b6c-9538242b3ea5\") " pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:27.897655 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.897617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4dh\" (UniqueName: \"kubernetes.io/projected/b6db3599-f13b-41f9-9bcb-692774d28e10-kube-api-access-5s4dh\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:27.897883 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.897769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk979\" (UniqueName: \"kubernetes.io/projected/40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f-kube-api-access-tk979\") pod \"multus-k9q22\" (UID: \"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f\") " pod="openshift-multus/multus-k9q22" Jul 27 09:50:27.898106 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.898057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gfnq\" (UniqueName: \"kubernetes.io/projected/1b0d0909-b8d9-4fc2-968d-1bb873bf291e-kube-api-access-9gfnq\") pod \"iptables-alerter-pftg2\" (UID: \"1b0d0909-b8d9-4fc2-968d-1bb873bf291e\") " pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:27.899094 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.899068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9svw\" (UniqueName: \"kubernetes.io/projected/0463c002-a8e0-4385-90d4-fb04d302c0be-kube-api-access-k9svw\") pod \"node-ca-5c5xt\" (UID: \"0463c002-a8e0-4385-90d4-fb04d302c0be\") " pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:27.899418 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.899399 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kptj6\" (UniqueName: \"kubernetes.io/projected/1074877b-bab2-488a-abf4-d59c2f1cf771-kube-api-access-kptj6\") pod \"multus-additional-cni-plugins-f2s5j\" (UID: \"1074877b-bab2-488a-abf4-d59c2f1cf771\") " pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:27.899485 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.899401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42pnd\" (UniqueName: \"kubernetes.io/projected/7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29-kube-api-access-42pnd\") pod \"node-resolver-cmfkm\" (UID: \"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29\") " pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:27.899554 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.899535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czqfr\" (UniqueName: \"kubernetes.io/projected/ee987323-9763-4df4-b1f4-6968732f2018-kube-api-access-czqfr\") pod \"ovnkube-node-gpnc8\" (UID: \"ee987323-9763-4df4-b1f4-6968732f2018\") " pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:27.909814 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:27.909771 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6591fe7dee8ebf5f58ccb667914ec553.slice/crio-0ef29e8a1d101ed46925675a6bec1018fd6982f0f5760e2d6e9a71b1e6f125c3 WatchSource:0}: Error finding container 0ef29e8a1d101ed46925675a6bec1018fd6982f0f5760e2d6e9a71b1e6f125c3: Status 404 returned error can't find the container with id 0ef29e8a1d101ed46925675a6bec1018fd6982f0f5760e2d6e9a71b1e6f125c3 Jul 27 09:50:27.910287 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:27.910270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd77e6fdc961fb201c2b3fe02df46d9.slice/crio-3f09c05cd10adad7a5de507f817a34f0b663eb70c3c2a0ea7aacf4db02fccc91 WatchSource:0}: Error finding container 3f09c05cd10adad7a5de507f817a34f0b663eb70c3c2a0ea7aacf4db02fccc91: Status 404 returned error can't find the container with id 3f09c05cd10adad7a5de507f817a34f0b663eb70c3c2a0ea7aacf4db02fccc91 Jul 27 09:50:27.915496 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.915482 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 09:50:27.997196 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:27.997146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" Jul 27 09:50:28.005670 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.005648 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0daa6d_fc5b_4f5f_a025_14b08693ad93.slice/crio-b7da78a8ab1c4b560b156a3877960976460251230d8828ff79c94951d308ef80 WatchSource:0}: Error finding container b7da78a8ab1c4b560b156a3877960976460251230d8828ff79c94951d308ef80: Status 404 returned error can't find the container with id b7da78a8ab1c4b560b156a3877960976460251230d8828ff79c94951d308ef80 Jul 27 09:50:28.011520 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.011505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cmfkm" Jul 27 09:50:28.019004 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.018984 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e15fcfa_9ebc_4ad1_ad1f_7b0e02fbbc29.slice/crio-1bd48940c875a91cd3148c2cb56f842b8038c3cc0fb609deb51c960380a10383 WatchSource:0}: Error finding container 1bd48940c875a91cd3148c2cb56f842b8038c3cc0fb609deb51c960380a10383: Status 404 returned error can't find the container with id 1bd48940c875a91cd3148c2cb56f842b8038c3cc0fb609deb51c960380a10383 Jul 27 09:50:28.028990 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.028974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" Jul 27 09:50:28.035710 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.035695 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37348a96_beac_4faf_8b6c_9538242b3ea5.slice/crio-a40db02bfeec9dfe73954c2dc5ac1693e34677e3831d6bdb251264fab21b82ba WatchSource:0}: Error finding container a40db02bfeec9dfe73954c2dc5ac1693e34677e3831d6bdb251264fab21b82ba: Status 404 returned error can't find the container with id a40db02bfeec9dfe73954c2dc5ac1693e34677e3831d6bdb251264fab21b82ba Jul 27 09:50:28.042714 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.042698 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" Jul 27 09:50:28.050307 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.050292 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1074877b_bab2_488a_abf4_d59c2f1cf771.slice/crio-8fed2c3a54d3333eb32f59b07d19791deb32bb6adf1c3b18623c99dc4ab783ff WatchSource:0}: Error finding container 8fed2c3a54d3333eb32f59b07d19791deb32bb6adf1c3b18623c99dc4ab783ff: Status 404 returned error can't find the container with id 8fed2c3a54d3333eb32f59b07d19791deb32bb6adf1c3b18623c99dc4ab783ff Jul 27 09:50:28.060766 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.060735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:28.067879 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.067865 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fdc7bf_b311_4e60_a5a1_bd30d1a97367.slice/crio-6b513f466e51cf70be03b316f9a97d4278f154ea66aebcade367011ce2299bd5 WatchSource:0}: Error finding container 6b513f466e51cf70be03b316f9a97d4278f154ea66aebcade367011ce2299bd5: Status 404 returned error can't find the container with id 6b513f466e51cf70be03b316f9a97d4278f154ea66aebcade367011ce2299bd5 Jul 27 09:50:28.073632 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.073618 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:28.080715 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.080697 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee987323_9763_4df4_b1f4_6968732f2018.slice/crio-a8920207db5d2ce65acc72b0540845dd25812addf302dadae408c36cf3ebcad2 WatchSource:0}: Error finding container a8920207db5d2ce65acc72b0540845dd25812addf302dadae408c36cf3ebcad2: Status 404 returned error can't find the container with id a8920207db5d2ce65acc72b0540845dd25812addf302dadae408c36cf3ebcad2 Jul 27 09:50:28.092836 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.092821 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pftg2" Jul 27 09:50:28.099533 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.099517 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0d0909_b8d9_4fc2_968d_1bb873bf291e.slice/crio-9da4dfcdc58e1a4a13f6cd2cf80f386a291f21027ce9e72ca05ff99c99e7ff7b WatchSource:0}: Error finding container 9da4dfcdc58e1a4a13f6cd2cf80f386a291f21027ce9e72ca05ff99c99e7ff7b: Status 404 returned error can't find the container with id 9da4dfcdc58e1a4a13f6cd2cf80f386a291f21027ce9e72ca05ff99c99e7ff7b Jul 27 09:50:28.115390 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.115370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9q22" Jul 27 09:50:28.118630 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.118550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5c5xt" Jul 27 09:50:28.124018 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.123999 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40140e9a_88c0_4ae7_bdfd_67cadfd6fc3f.slice/crio-b5a64ebe09ff5031442bc24e87dbfe399c21e477911ae00499702c4df496dcfb WatchSource:0}: Error finding container b5a64ebe09ff5031442bc24e87dbfe399c21e477911ae00499702c4df496dcfb: Status 404 returned error can't find the container with id b5a64ebe09ff5031442bc24e87dbfe399c21e477911ae00499702c4df496dcfb Jul 27 09:50:28.126441 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:50:28.126424 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0463c002_a8e0_4385_90d4_fb04d302c0be.slice/crio-f113a6c8df92377a23905ae7d6ed6b8b1ca4515b50212555ed047934fb1eafa6 WatchSource:0}: Error finding container f113a6c8df92377a23905ae7d6ed6b8b1ca4515b50212555ed047934fb1eafa6: Status 404 returned error can't find the container with id f113a6c8df92377a23905ae7d6ed6b8b1ca4515b50212555ed047934fb1eafa6 Jul 27 09:50:28.161079 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.161058 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:28.390806 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.390569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:28.390806 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.390616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:28.391001 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.390854 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:28.391001 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.390933 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:29.390913984 +0000 UTC m=+3.050899788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:28.391337 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.391256 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:28.391337 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.391315 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:29.391299696 +0000 UTC m=+3.051285518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:28.466547 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.466349 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:28.492210 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.491671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:28.492210 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.491825 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:28.492210 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.491847 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:28.492210 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.491857 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:28.492210 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.491905 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:29.491889781 +0000 UTC m=+3.151875587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:28.750221 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.750162 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 09:45:27 +0000 UTC" deadline="2028-02-02 13:19:31.343065424 +0000 UTC" Jul 27 09:50:28.750221 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.750219 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13323h29m2.5928502s" Jul 27 09:50:28.811864 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.811842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:28.812002 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.811946 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:28.812809 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.812790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:28.812957 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:28.812938 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:28.843220 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.843122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pftg2" event={"ID":"1b0d0909-b8d9-4fc2-968d-1bb873bf291e","Type":"ContainerStarted","Data":"9da4dfcdc58e1a4a13f6cd2cf80f386a291f21027ce9e72ca05ff99c99e7ff7b"} Jul 27 09:50:28.872808 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.872778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerStarted","Data":"8fed2c3a54d3333eb32f59b07d19791deb32bb6adf1c3b18623c99dc4ab783ff"} Jul 27 09:50:28.884943 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.884914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5c5xt" event={"ID":"0463c002-a8e0-4385-90d4-fb04d302c0be","Type":"ContainerStarted","Data":"f113a6c8df92377a23905ae7d6ed6b8b1ca4515b50212555ed047934fb1eafa6"} Jul 27 09:50:28.888317 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.888229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"a8920207db5d2ce65acc72b0540845dd25812addf302dadae408c36cf3ebcad2"} Jul 27 09:50:28.906401 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.906374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q7t68" event={"ID":"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367","Type":"ContainerStarted","Data":"6b513f466e51cf70be03b316f9a97d4278f154ea66aebcade367011ce2299bd5"} Jul 27 09:50:28.918801 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.918777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" event={"ID":"37348a96-beac-4faf-8b6c-9538242b3ea5","Type":"ContainerStarted","Data":"a40db02bfeec9dfe73954c2dc5ac1693e34677e3831d6bdb251264fab21b82ba"} Jul 27 09:50:28.943237 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.943203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cmfkm" event={"ID":"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29","Type":"ContainerStarted","Data":"1bd48940c875a91cd3148c2cb56f842b8038c3cc0fb609deb51c960380a10383"} Jul 27 09:50:28.969228 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:28.969194 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" event={"ID":"ba0daa6d-fc5b-4f5f-a025-14b08693ad93","Type":"ContainerStarted","Data":"b7da78a8ab1c4b560b156a3877960976460251230d8828ff79c94951d308ef80"} Jul 27 09:50:29.006075 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.006002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" event={"ID":"6591fe7dee8ebf5f58ccb667914ec553","Type":"ContainerStarted","Data":"0ef29e8a1d101ed46925675a6bec1018fd6982f0f5760e2d6e9a71b1e6f125c3"} Jul 27 09:50:29.012579 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.012487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" event={"ID":"1fd77e6fdc961fb201c2b3fe02df46d9","Type":"ContainerStarted","Data":"3f09c05cd10adad7a5de507f817a34f0b663eb70c3c2a0ea7aacf4db02fccc91"} Jul 27 09:50:29.015246 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.015172 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9q22" event={"ID":"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f","Type":"ContainerStarted","Data":"b5a64ebe09ff5031442bc24e87dbfe399c21e477911ae00499702c4df496dcfb"} Jul 27 09:50:29.399370 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.399338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:29.399545 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.399386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:29.399545 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.399520 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:29.399658 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.399577 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:31.399560595 +0000 UTC m=+5.059546406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:29.404936 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.400003 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:29.404936 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.400054 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:31.400039601 +0000 UTC m=+5.060025409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:29.500456 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.500118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:29.500456 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.500343 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:29.500456 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.500365 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:29.500456 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.500378 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:29.500456 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.500430 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:31.500412949 +0000 UTC m=+5.160398770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:29.634776 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.634678 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:50:29.750565 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.750528 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 09:45:27 +0000 UTC" deadline="2028-01-07 10:24:30.984345974 +0000 UTC" Jul 27 09:50:29.750565 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.750562 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12696h34m1.233788759s" Jul 27 09:50:29.813346 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:29.811229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:29.813346 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:29.811367 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:30.810983 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:30.810942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:30.811600 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:30.811070 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:30.811600 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:30.811118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:30.811600 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:30.811219 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:31.417253 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:31.417221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:31.417431 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:31.417277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:31.417498 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.417439 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:31.417548 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.417500 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:35.417481776 +0000 UTC m=+9.077467599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:31.417811 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.417688 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:31.417811 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.417766 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:35.417732723 +0000 UTC m=+9.077718528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:31.518524 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:31.518466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:31.518759 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.518720 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:31.518759 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.518765 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:31.518946 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.518778 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:31.518946 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.518833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:35.518818202 +0000 UTC m=+9.178804007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:31.810415 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:31.810384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:31.810595 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:31.810519 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:32.813340 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:32.811381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:32.813340 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:32.811504 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:32.813340 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:32.811848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:32.813340 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:32.811949 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:33.810344 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:33.810306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:33.810515 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:33.810447 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:34.811865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:34.811811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:34.812220 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:34.811941 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:34.812322 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:34.812295 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:34.812460 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:34.812438 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:35.454532 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:35.454491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:35.454711 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:35.454551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:35.454711 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.454666 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:35.454844 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.454730 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:35.454844 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.454764 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:43.454726557 +0000 UTC m=+17.114712379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:35.454844 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.454802 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:43.454786683 +0000 UTC m=+17.114772494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:35.555633 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:35.555603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:35.555809 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.555723 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:35.555809 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.555740 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:35.555809 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.555767 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:35.555915 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.555822 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:43.555804144 +0000 UTC m=+17.215789955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:35.810689 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:35.810607 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:35.810875 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:35.810760 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:36.811462 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:36.811421 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:36.811921 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:36.811541 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:36.811986 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:36.811925 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:36.812043 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:36.812010 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:37.810371 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:37.810344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:37.810542 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:37.810474 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:38.811260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:38.810795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:38.811260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:38.810801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:38.811260 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:38.810925 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:38.811260 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:38.811001 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:39.810520 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:39.810455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:39.810655 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:39.810592 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:40.810583 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:40.810548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:40.811026 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:40.810682 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:40.811026 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:40.810727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:40.811026 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:40.810857 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:41.810643 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:41.810606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:41.811122 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:41.810758 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:42.810465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:42.810425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:42.810644 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:42.810564 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:42.810644 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:42.810578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:42.811009 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:42.810668 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:43.515161 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:43.515123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:43.515161 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:43.515159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:43.515359 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.515321 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:43.515359 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.515332 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:43.515419 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.515373 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:59.515359515 +0000 UTC m=+33.175345321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:43.515419 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.515386 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:59.515379856 +0000 UTC m=+33.175365661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:43.615973 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:43.615936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:43.616144 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.616063 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:43.616144 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.616077 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:43.616144 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.616085 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:43.616144 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.616134 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:50:59.616122453 +0000 UTC m=+33.276108258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:43.810637 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:43.810555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:43.810863 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:43.810684 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:44.810886 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:44.810845 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:44.810886 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:44.810879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:44.811348 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:44.811005 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:44.811348 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:44.811087 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:45.810474 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:45.810446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:45.810675 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:45.810571 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:46.811716 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:46.811677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:46.812144 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:46.811824 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:46.812144 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:46.811878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:46.812144 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:46.812011 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:47.810510 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:47.810478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:47.810673 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:47.810588 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:48.811678 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:48.811252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:48.812140 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:48.811307 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:48.812202 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:48.812149 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:48.815042 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:48.812407 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:49.068024 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.067985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" event={"ID":"1fd77e6fdc961fb201c2b3fe02df46d9","Type":"ContainerStarted","Data":"d5a8485d161044f7ebdf1e278dea24f746b87b6bdfa53761659dcb66e1f96a9d"} Jul 27 09:50:49.069471 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.069441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9q22" event={"ID":"40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f","Type":"ContainerStarted","Data":"6618c70b7bccf5e0a9c1050fc6d35b969e48d2edd8ddf2b7da904a80ba525cd9"} Jul 27 09:50:49.070800 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.070780 2581 generic.go:356] "Generic (PLEG): container finished" podID="1074877b-bab2-488a-abf4-d59c2f1cf771" containerID="42257dff493c756f4f5a3d71093fbd591448ab3b637973701f5758ed17f9e65d" exitCode=0 Jul 27 09:50:49.070890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.070826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerDied","Data":"42257dff493c756f4f5a3d71093fbd591448ab3b637973701f5758ed17f9e65d"} Jul 27 09:50:49.072336 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.072279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5c5xt" event={"ID":"0463c002-a8e0-4385-90d4-fb04d302c0be","Type":"ContainerStarted","Data":"8919e6f9322a1e22d8b23df1138f157020d074c69e934f708529e08c83cff41b"} Jul 27 09:50:49.075201 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.075181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"9991224fcaa3898fef60455088daaa3743d8b50eb8168d7579e9af6e2ab6fec4"} Jul 27 09:50:49.075288 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.075241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"2a61175b8d96b765a89cf2fd7db265448714b41a90bea4ad6d0b0f28a9ef5139"} Jul 27 09:50:49.075288 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.075273 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"c42fcf46f4e6a947faf00d672cccc01222d0f30589dfd63cbab9ea388198d17c"} Jul 27 09:50:49.075370 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.075318 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"42a29548e00230b569628705ceb59c9923f592db0a2658e203b762ae2eacc24e"} Jul 27 09:50:49.075370 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.075360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"08a3af43a2ba16bcf8730fa3e56fea9b4e9c763cb0bbd92142432b1ae9cfc8c3"} Jul 27 09:50:49.075450 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.075388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"e20abdad8e11c635c8893e3c79d4a0259443176511c2642ab16663d4d67183f9"} Jul 27 09:50:49.076511 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.076490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q7t68" event={"ID":"b8fdc7bf-b311-4e60-a5a1-bd30d1a97367","Type":"ContainerStarted","Data":"da320382c2cb01ba11b5e5d7c10c27890b6942d9c044040472675c5b24a150cf"} Jul 27 09:50:49.078322 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.078304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" event={"ID":"37348a96-beac-4faf-8b6c-9538242b3ea5","Type":"ContainerStarted","Data":"fda0494358ac82c162c3d6659b4fd442435422f10cf6ae1e8446eadc31f35087"} Jul 27 09:50:49.079600 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.079582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cmfkm" event={"ID":"7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29","Type":"ContainerStarted","Data":"89849027de31f948db1f394ae0216f52c480bee237216ac8994011e3d766e537"} Jul 27 09:50:49.080806 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.080785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" event={"ID":"ba0daa6d-fc5b-4f5f-a025-14b08693ad93","Type":"ContainerStarted","Data":"f13f53a0d3d34656514f902efb9e33bc94514678e71bea91b6e02812e8251213"} Jul 27 09:50:49.081969 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.081949 2581 generic.go:356] "Generic (PLEG): container finished" podID="6591fe7dee8ebf5f58ccb667914ec553" containerID="6f154ed1c70aa4eafd63fc9d9eba2cad48134d44ab881b5d2ca925190a2af5b3" exitCode=0 Jul 27 09:50:49.082046 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.081984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" event={"ID":"6591fe7dee8ebf5f58ccb667914ec553","Type":"ContainerDied","Data":"6f154ed1c70aa4eafd63fc9d9eba2cad48134d44ab881b5d2ca925190a2af5b3"} Jul 27 09:50:49.085081 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.085044 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-146.ec2.internal" podStartSLOduration=22.085031714 podStartE2EDuration="22.085031714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:49.084558219 +0000 UTC m=+22.744544048" watchObservedRunningTime="2026-07-27 09:50:49.085031714 +0000 UTC m=+22.745017542" Jul 27 09:50:49.102252 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.102212 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k9q22" podStartSLOduration=3.1272003919999998 podStartE2EDuration="23.102196165s" totalImagesPullingTime="19.974995773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:49.101966277 +0000 UTC m=+22.761952104" watchObservedRunningTime="2026-07-27 09:50:49.102196165 +0000 UTC m=+22.762181992" Jul 27 09:50:49.118813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.118762 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5c5xt" podStartSLOduration=3.216981086 podStartE2EDuration="23.118729797s" totalImagesPullingTime="19.901748711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:49.118431083 +0000 UTC m=+22.778416910" watchObservedRunningTime="2026-07-27 09:50:49.118729797 +0000 UTC m=+22.778715665" Jul 27 09:50:49.150926 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.150877 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cmfkm" podStartSLOduration=3.073760839 podStartE2EDuration="23.150860468s" totalImagesPullingTime="20.077099629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:49.150843096 +0000 UTC m=+22.810828923" watchObservedRunningTime="2026-07-27 09:50:49.150860468 +0000 UTC m=+22.810846296" Jul 27 09:50:49.170352 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.170122 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kqzbv" podStartSLOduration=3.17758226 podStartE2EDuration="23.170106333s" totalImagesPullingTime="19.992524073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:49.169811413 +0000 UTC m=+22.829797240" watchObservedRunningTime="2026-07-27 09:50:49.170106333 +0000 UTC m=+22.830092158" Jul 27 09:50:49.213048 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.212990 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q7t68" podStartSLOduration=3.252624457 podStartE2EDuration="23.212965344s" totalImagesPullingTime="19.960340887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:49.212866673 +0000 UTC m=+22.872852499" watchObservedRunningTime="2026-07-27 09:50:49.212965344 +0000 UTC m=+22.872951352" Jul 27 09:50:49.810961 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:49.810874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:49.811141 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:49.811009 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:50.086378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.086334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pftg2" event={"ID":"1b0d0909-b8d9-4fc2-968d-1bb873bf291e","Type":"ContainerStarted","Data":"1941e05bc0cf085f2b3010aa545d17d35cf40655a58c24419dbc304424320924"} Jul 27 09:50:50.088408 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.088379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" event={"ID":"6591fe7dee8ebf5f58ccb667914ec553","Type":"ContainerStarted","Data":"c8005e5f30bc137af9db592ded4e6a713bb16dc2fb89b344df0ebf49b6ee862a"} Jul 27 09:50:50.103917 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.103868 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pftg2" podStartSLOduration=4.102763105 podStartE2EDuration="24.103853695s" totalImagesPullingTime="20.00109059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:50.10379315 +0000 UTC m=+23.763778976" watchObservedRunningTime="2026-07-27 09:50:50.103853695 +0000 UTC m=+23.763839521" Jul 27 09:50:50.121396 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.121343 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-146.ec2.internal" podStartSLOduration=23.121323202 podStartE2EDuration="23.121323202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:50.121288014 +0000 UTC m=+23.781273840" watchObservedRunningTime="2026-07-27 09:50:50.121323202 +0000 UTC m=+23.781309029" Jul 27 09:50:50.225398 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.225368 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 09:50:50.622160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.622131 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:50.622881 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.622858 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:50.745349 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.745191 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T09:50:50.225392584Z","UUID":"0393766f-49a5-492a-a7b1-586649d7c130","Handler":null,"Name":"","Endpoint":""} Jul 27 09:50:50.747077 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.747053 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 09:50:50.747250 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.747093 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 09:50:50.810609 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.810582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:50.810792 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:50.810701 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:50.810792 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:50.810761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:50.810908 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:50.810868 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:51.092918 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:51.092886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" event={"ID":"ba0daa6d-fc5b-4f5f-a025-14b08693ad93","Type":"ContainerStarted","Data":"acf3295fcdf9a2268f854be7e1abdc3692eb213415ee6f0f529bd8b48cae0b61"} Jul 27 09:50:51.093292 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:51.092958 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:51.094146 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:51.094129 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q7t68" Jul 27 09:50:51.810780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:51.810740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:51.810957 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:51.810876 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:52.097419 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:52.097304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" event={"ID":"ba0daa6d-fc5b-4f5f-a025-14b08693ad93","Type":"ContainerStarted","Data":"1125c53ac9e7aa84cddcbccfc6bc0fddcf6a3e84626327c5eab1935d1f9c45e1"} Jul 27 09:50:52.103366 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:52.103335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"2eb998b1cd771fc53d1897e768becb267716d080818f6605e3d59fa20f3850e9"} Jul 27 09:50:52.120000 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:52.119957 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lstxg" podStartSLOduration=3.451512243 podStartE2EDuration="26.119943119s" totalImagesPullingTime="22.668430876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:52.118493331 +0000 UTC m=+25.778479158" watchObservedRunningTime="2026-07-27 09:50:52.119943119 +0000 UTC m=+25.779928953" Jul 27 09:50:52.811300 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:52.811267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:52.811466 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:52.811395 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:52.811466 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:52.811454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:52.811591 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:52.811565 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:53.810834 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:53.810802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:53.811268 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:53.810909 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:54.110925 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.110846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" event={"ID":"ee987323-9763-4df4-b1f4-6968732f2018","Type":"ContainerStarted","Data":"8d9883621962e2d28dccb2dbf39b0f15ec786d5789d0e46e9d9705ceac03c5d2"} Jul 27 09:50:54.111102 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.111084 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:54.111164 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.111142 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:54.112791 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.112767 2581 generic.go:356] "Generic (PLEG): container finished" podID="1074877b-bab2-488a-abf4-d59c2f1cf771" containerID="f21819e25b2ffb851c74b08a42989d8fd1d9c8385fdf9bc1a34d90743feac177" exitCode=0 Jul 27 09:50:54.112920 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.112798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerDied","Data":"f21819e25b2ffb851c74b08a42989d8fd1d9c8385fdf9bc1a34d90743feac177"} Jul 27 09:50:54.127605 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.127584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:54.154434 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.154386 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" podStartSLOduration=8.01762227 podStartE2EDuration="28.154371588s" totalImagesPullingTime="20.136749318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:50:54.152230494 +0000 UTC m=+27.812216321" watchObservedRunningTime="2026-07-27 09:50:54.154371588 +0000 UTC m=+27.814357414" Jul 27 09:50:54.811470 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.811440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:54.812058 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:54.811447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:54.812058 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:54.811577 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:54.812058 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:54.811641 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:55.119627 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.119544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:55.138124 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.138100 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:50:55.810675 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.810645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:55.810853 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:55.810762 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:55.854490 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.854427 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zvq9q"] Jul 27 09:50:55.861412 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.861382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-46qr2"] Jul 27 09:50:55.861612 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.861490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:55.861681 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:55.861602 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:55.862073 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.862052 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gx68r"] Jul 27 09:50:55.862176 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:55.862135 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:55.862249 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:55.862227 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:56.119772 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:56.119717 2581 generic.go:356] "Generic (PLEG): container finished" podID="1074877b-bab2-488a-abf4-d59c2f1cf771" containerID="a33300ebaadb41254b846a69dca97561fe1d085606018d0894900415daa2fd33" exitCode=0 Jul 27 09:50:56.119955 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:56.119808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerDied","Data":"a33300ebaadb41254b846a69dca97561fe1d085606018d0894900415daa2fd33"} Jul 27 09:50:56.119955 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:56.119857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:56.120074 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:56.119957 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:57.124043 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:57.123857 2581 generic.go:356] "Generic (PLEG): container finished" podID="1074877b-bab2-488a-abf4-d59c2f1cf771" containerID="bb105c8c62ff9636a3cd4885d9888128cacdc4b2d6ae0e06d3067d179cc0592b" exitCode=0 Jul 27 09:50:57.124515 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:57.123943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerDied","Data":"bb105c8c62ff9636a3cd4885d9888128cacdc4b2d6ae0e06d3067d179cc0592b"} Jul 27 09:50:57.810306 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:57.810281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:57.810439 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:57.810281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:57.810439 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:57.810373 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:50:57.810512 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:57.810464 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:57.810512 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:57.810281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:57.810572 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:57.810537 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:59.532991 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:59.532961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:59.532991 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:59.532998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:59.533434 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.533103 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:59.533434 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.533108 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:59.533434 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.533152 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret podName:5f030b68-47a0-4e5d-9776-3499c80fb0a6 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:31.533138849 +0000 UTC m=+65.193124654 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret") pod "global-pull-secret-syncer-46qr2" (UID: "5f030b68-47a0-4e5d-9776-3499c80fb0a6") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:50:59.533434 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.533166 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:31.533159656 +0000 UTC m=+65.193145461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:50:59.634696 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:59.634180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:59.634696 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.634334 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:50:59.634696 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.634351 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:50:59.634696 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.634359 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xgk69 for pod openshift-network-diagnostics/network-check-target-gx68r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:59.634696 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.634413 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69 podName:26c58a5a-8adf-42b6-9ebb-9b967e25a4d5 nodeName:}" failed. No retries permitted until 2026-07-27 09:51:31.634396333 +0000 UTC m=+65.294382140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgk69" (UniqueName: "kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69") pod "network-check-target-gx68r" (UID: "26c58a5a-8adf-42b6-9ebb-9b967e25a4d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:50:59.811228 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:59.811151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:50:59.811228 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:59.811162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:50:59.811435 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.811266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:50:59.811435 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:50:59.811299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:50:59.811435 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.811397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:50:59.811585 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:50:59.811456 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:51:01.810899 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:01.810866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:51:01.810899 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:01.810895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:51:01.811295 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:01.810973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:51:01.811295 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:01.810988 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:51:01.811295 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:01.811047 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gx68r" podUID="26c58a5a-8adf-42b6-9ebb-9b967e25a4d5" Jul 27 09:51:01.811295 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:01.811124 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-46qr2" podUID="5f030b68-47a0-4e5d-9776-3499c80fb0a6" Jul 27 09:51:02.165854 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.165834 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-146.ec2.internal" event="NodeReady" Jul 27 09:51:02.165961 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.165949 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 09:51:02.234461 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.234436 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c4mkz"] Jul 27 09:51:02.236318 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.236294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.237558 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.237536 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rhjr2"] Jul 27 09:51:02.239259 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.239239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.240783 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.240551 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hlctp\"" Jul 27 09:51:02.240783 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.240563 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 09:51:02.240783 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.240576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 09:51:02.240783 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.240568 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 09:51:02.244279 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.244185 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9nsb\"" Jul 27 09:51:02.246421 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.246402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 09:51:02.247270 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.247160 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 09:51:02.251468 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.251447 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c4mkz"] Jul 27 09:51:02.254770 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.254467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rhjr2"] Jul 27 09:51:02.352856 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.352831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b086bd-8aa3-4928-bcca-82e1fce413ec-tmp-dir\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.352962 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.352867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l49fd\" (UniqueName: \"kubernetes.io/projected/5ece7cf3-e32d-48e0-8574-0f28133ca284-kube-api-access-l49fd\") pod \"ingress-canary-c4mkz\" (UID: \"5ece7cf3-e32d-48e0-8574-0f28133ca284\") " pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.352962 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.352897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ece7cf3-e32d-48e0-8574-0f28133ca284-cert\") pod \"ingress-canary-c4mkz\" (UID: \"5ece7cf3-e32d-48e0-8574-0f28133ca284\") " pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.353035 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.352999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63b086bd-8aa3-4928-bcca-82e1fce413ec-config-volume\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.353177 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.353032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.353177 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.353066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9s9m\" (UniqueName: \"kubernetes.io/projected/63b086bd-8aa3-4928-bcca-82e1fce413ec-kube-api-access-t9s9m\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.453966 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.453935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9s9m\" (UniqueName: \"kubernetes.io/projected/63b086bd-8aa3-4928-bcca-82e1fce413ec-kube-api-access-t9s9m\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.454057 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.453993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b086bd-8aa3-4928-bcca-82e1fce413ec-tmp-dir\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.454057 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.454011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l49fd\" (UniqueName: \"kubernetes.io/projected/5ece7cf3-e32d-48e0-8574-0f28133ca284-kube-api-access-l49fd\") pod \"ingress-canary-c4mkz\" (UID: \"5ece7cf3-e32d-48e0-8574-0f28133ca284\") " pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.454057 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.454027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ece7cf3-e32d-48e0-8574-0f28133ca284-cert\") pod \"ingress-canary-c4mkz\" (UID: \"5ece7cf3-e32d-48e0-8574-0f28133ca284\") " pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.454156 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.454057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63b086bd-8aa3-4928-bcca-82e1fce413ec-config-volume\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.454156 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.454073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.454233 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:02.454169 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:02.454233 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:02.454223 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:51:02.954204177 +0000 UTC m=+36.614190003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:02.454329 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.454311 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b086bd-8aa3-4928-bcca-82e1fce413ec-tmp-dir\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.454588 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.454569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63b086bd-8aa3-4928-bcca-82e1fce413ec-config-volume\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.458649 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.458626 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ece7cf3-e32d-48e0-8574-0f28133ca284-cert\") pod \"ingress-canary-c4mkz\" (UID: \"5ece7cf3-e32d-48e0-8574-0f28133ca284\") " pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.469567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.469539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l49fd\" (UniqueName: \"kubernetes.io/projected/5ece7cf3-e32d-48e0-8574-0f28133ca284-kube-api-access-l49fd\") pod \"ingress-canary-c4mkz\" (UID: \"5ece7cf3-e32d-48e0-8574-0f28133ca284\") " pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.470969 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.470950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9s9m\" (UniqueName: \"kubernetes.io/projected/63b086bd-8aa3-4928-bcca-82e1fce413ec-kube-api-access-t9s9m\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.549944 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.549911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c4mkz" Jul 27 09:51:02.677781 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.677735 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c4mkz"] Jul 27 09:51:02.681656 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:51:02.681634 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ece7cf3_e32d_48e0_8574_0f28133ca284.slice/crio-3b478c59c279445f53ceee493708c0028ebe717f82e2686f5f78ea1bab3525f1 WatchSource:0}: Error finding container 3b478c59c279445f53ceee493708c0028ebe717f82e2686f5f78ea1bab3525f1: Status 404 returned error can't find the container with id 3b478c59c279445f53ceee493708c0028ebe717f82e2686f5f78ea1bab3525f1 Jul 27 09:51:02.957468 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:02.957445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:02.957958 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:02.957547 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:02.957958 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:02.957598 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:51:03.957582797 +0000 UTC m=+37.617568620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:03.139430 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.139391 2581 generic.go:356] "Generic (PLEG): container finished" podID="1074877b-bab2-488a-abf4-d59c2f1cf771" containerID="662ddb6232e21bfac58d107330d23f90930b969be9574226b3ea383477eb6928" exitCode=0 Jul 27 09:51:03.139605 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.139482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerDied","Data":"662ddb6232e21bfac58d107330d23f90930b969be9574226b3ea383477eb6928"} Jul 27 09:51:03.140712 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.140690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c4mkz" event={"ID":"5ece7cf3-e32d-48e0-8574-0f28133ca284","Type":"ContainerStarted","Data":"3b478c59c279445f53ceee493708c0028ebe717f82e2686f5f78ea1bab3525f1"} Jul 27 09:51:03.811530 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.811267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:51:03.811530 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.811371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:51:03.811530 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.811490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:51:03.814575 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.814553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 09:51:03.815652 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.815633 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 09:51:03.815948 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.815932 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 09:51:03.816155 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.816140 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ngfpk\"" Jul 27 09:51:03.816334 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.816321 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 09:51:03.816532 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.816516 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66rjs\"" Jul 27 09:51:03.965624 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:03.965589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:03.966223 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:03.965737 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:03.966223 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:03.965826 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:51:05.965805248 +0000 UTC m=+39.625791087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:04.146417 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:04.146345 2581 generic.go:356] "Generic (PLEG): container finished" podID="1074877b-bab2-488a-abf4-d59c2f1cf771" containerID="66dad2614f16483d8d50df5aba9bd79dc8ae165a82c3d89f967eb23fd068fc42" exitCode=0 Jul 27 09:51:04.146545 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:04.146415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerDied","Data":"66dad2614f16483d8d50df5aba9bd79dc8ae165a82c3d89f967eb23fd068fc42"} Jul 27 09:51:05.152830 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:05.152608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" event={"ID":"1074877b-bab2-488a-abf4-d59c2f1cf771","Type":"ContainerStarted","Data":"92bfba3e7a6ac303ab694c746ecb3d182e72bcb78884a26559298642644375a1"} Jul 27 09:51:05.153968 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:05.153940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c4mkz" event={"ID":"5ece7cf3-e32d-48e0-8574-0f28133ca284","Type":"ContainerStarted","Data":"939e07a1aedab8b8c8dd114dad030910c50a4ef2798ea5bd65f7f822b4dfa055"} Jul 27 09:51:05.181045 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:05.180999 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f2s5j" podStartSLOduration=8.240267489 podStartE2EDuration="39.180985305s" totalImagesPullingTime="30.940717816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:05.179403044 +0000 UTC m=+38.839388871" watchObservedRunningTime="2026-07-27 09:51:05.180985305 +0000 UTC m=+38.840971132" Jul 27 09:51:05.196030 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:05.195981 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c4mkz" podStartSLOduration=1.21427549 podStartE2EDuration="3.195967255s" totalImagesPullingTime="1.981691765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:05.195403405 +0000 UTC m=+38.855389233" watchObservedRunningTime="2026-07-27 09:51:05.195967255 +0000 UTC m=+38.855953061" Jul 27 09:51:05.981841 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:05.981798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:05.982017 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:05.981956 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:05.982090 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:05.982020 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:51:09.982003673 +0000 UTC m=+43.641989546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:10.009319 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:10.009280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:10.009794 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:10.009445 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:10.009794 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:10.009526 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:51:18.009504733 +0000 UTC m=+51.669490546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:16.016434 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.016406 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7"] Jul 27 09:51:16.027335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.027313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.029536 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.029516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7"] Jul 27 09:51:16.030697 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.030673 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 09:51:16.030819 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.030675 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vwpkr\"" Jul 27 09:51:16.032516 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.032498 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 09:51:16.032632 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.032537 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 09:51:16.032702 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.032650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 09:51:16.150593 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.150565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9878a111-31b9-4522-9505-df02bcd6451b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7\" (UID: \"9878a111-31b9-4522-9505-df02bcd6451b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.150731 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.150611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56h28\" (UniqueName: \"kubernetes.io/projected/9878a111-31b9-4522-9505-df02bcd6451b-kube-api-access-56h28\") pod \"managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7\" (UID: \"9878a111-31b9-4522-9505-df02bcd6451b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.251505 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.251473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9878a111-31b9-4522-9505-df02bcd6451b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7\" (UID: \"9878a111-31b9-4522-9505-df02bcd6451b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.251634 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.251532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56h28\" (UniqueName: \"kubernetes.io/projected/9878a111-31b9-4522-9505-df02bcd6451b-kube-api-access-56h28\") pod \"managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7\" (UID: \"9878a111-31b9-4522-9505-df02bcd6451b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.255256 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.255231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9878a111-31b9-4522-9505-df02bcd6451b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7\" (UID: \"9878a111-31b9-4522-9505-df02bcd6451b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.261346 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.261328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56h28\" (UniqueName: \"kubernetes.io/projected/9878a111-31b9-4522-9505-df02bcd6451b-kube-api-access-56h28\") pod \"managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7\" (UID: \"9878a111-31b9-4522-9505-df02bcd6451b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.347372 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.347328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:51:16.484983 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:16.484958 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7"] Jul 27 09:51:16.488799 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:51:16.488774 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9878a111_31b9_4522_9505_df02bcd6451b.slice/crio-50baac86f8264edf1f58220b0d91721cd2236d77c4ba8849a401d5dc567967ee WatchSource:0}: Error finding container 50baac86f8264edf1f58220b0d91721cd2236d77c4ba8849a401d5dc567967ee: Status 404 returned error can't find the container with id 50baac86f8264edf1f58220b0d91721cd2236d77c4ba8849a401d5dc567967ee Jul 27 09:51:17.183591 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:17.183557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" event={"ID":"9878a111-31b9-4522-9505-df02bcd6451b","Type":"ContainerStarted","Data":"50baac86f8264edf1f58220b0d91721cd2236d77c4ba8849a401d5dc567967ee"} Jul 27 09:51:18.066649 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:18.066610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:18.066859 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:18.066810 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:18.066933 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:18.066896 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:51:34.066874056 +0000 UTC m=+67.726859880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:21.193838 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:21.193804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" event={"ID":"9878a111-31b9-4522-9505-df02bcd6451b","Type":"ContainerStarted","Data":"e7fbea2538c9a038490c116ed33014f6097def69ba8fdd8e31f592e8d138ef30"} Jul 27 09:51:21.218008 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:21.217965 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" podStartSLOduration=2.474712311 podStartE2EDuration="6.217949963s" totalImagesPullingTime="3.743237652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:21.216489942 +0000 UTC m=+54.876475769" watchObservedRunningTime="2026-07-27 09:51:21.217949963 +0000 UTC m=+54.877935789" Jul 27 09:51:27.140227 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:27.140200 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gpnc8" Jul 27 09:51:31.558754 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.558705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:51:31.558754 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.558755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:51:31.561931 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.561912 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 09:51:31.561992 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.561954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 09:51:31.569294 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:31.569263 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:51:31.569382 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:31.569333 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:52:35.569315733 +0000 UTC m=+129.229301538 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : secret "metrics-daemon-secret" not found Jul 27 09:51:31.571496 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.571479 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f030b68-47a0-4e5d-9776-3499c80fb0a6-original-pull-secret\") pod \"global-pull-secret-syncer-46qr2\" (UID: \"5f030b68-47a0-4e5d-9776-3499c80fb0a6\") " pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:51:31.659809 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.659770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:51:31.663291 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.663269 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 09:51:31.673921 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.673897 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 09:51:31.683675 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.683646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgk69\" (UniqueName: \"kubernetes.io/projected/26c58a5a-8adf-42b6-9ebb-9b967e25a4d5-kube-api-access-xgk69\") pod \"network-check-target-gx68r\" (UID: \"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5\") " pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:51:31.723853 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.723827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-46qr2" Jul 27 09:51:31.740800 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.740778 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66rjs\"" Jul 27 09:51:31.748465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.748446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:51:31.882385 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.882353 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-46qr2"] Jul 27 09:51:31.886254 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:51:31.886229 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f030b68_47a0_4e5d_9776_3499c80fb0a6.slice/crio-582ce8a1ef95939090a8b9f860cd0a90303052326315dcc7674d332422b61c3a WatchSource:0}: Error finding container 582ce8a1ef95939090a8b9f860cd0a90303052326315dcc7674d332422b61c3a: Status 404 returned error can't find the container with id 582ce8a1ef95939090a8b9f860cd0a90303052326315dcc7674d332422b61c3a Jul 27 09:51:31.900890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:31.900869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gx68r"] Jul 27 09:51:31.904088 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:51:31.904071 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c58a5a_8adf_42b6_9ebb_9b967e25a4d5.slice/crio-f837084d97d01fb428110d61fe46172ef34eda8d5b4caeeacaa9b19ab233bc37 WatchSource:0}: Error finding container f837084d97d01fb428110d61fe46172ef34eda8d5b4caeeacaa9b19ab233bc37: Status 404 returned error can't find the container with id f837084d97d01fb428110d61fe46172ef34eda8d5b4caeeacaa9b19ab233bc37 Jul 27 09:51:32.220071 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:32.220040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gx68r" event={"ID":"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5","Type":"ContainerStarted","Data":"f837084d97d01fb428110d61fe46172ef34eda8d5b4caeeacaa9b19ab233bc37"} Jul 27 09:51:32.221067 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:32.221048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-46qr2" event={"ID":"5f030b68-47a0-4e5d-9776-3499c80fb0a6","Type":"ContainerStarted","Data":"582ce8a1ef95939090a8b9f860cd0a90303052326315dcc7674d332422b61c3a"} Jul 27 09:51:34.075898 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:34.075865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:51:34.076358 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:34.076001 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:51:34.076358 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:51:34.076065 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:52:06.07604808 +0000 UTC m=+99.736033909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:51:37.235304 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:37.235268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-46qr2" event={"ID":"5f030b68-47a0-4e5d-9776-3499c80fb0a6","Type":"ContainerStarted","Data":"58068f8a343ebae9c0663aa0e972ee04ac8dbd9938e133e22e9a5a7ef5a1376f"} Jul 27 09:51:37.236673 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:37.236651 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gx68r" event={"ID":"26c58a5a-8adf-42b6-9ebb-9b967e25a4d5","Type":"ContainerStarted","Data":"4c88794002302df77ec59895d1cd30ffa2e19b9d3fccd9d7894391d8e40e5f5f"} Jul 27 09:51:37.236804 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:37.236789 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:51:37.251955 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:37.251820 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-46qr2" podStartSLOduration=66.513012671 podStartE2EDuration="1m11.251808314s" totalImagesPullingTime="4.738795643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:37.25142671 +0000 UTC m=+70.911412537" watchObservedRunningTime="2026-07-27 09:51:37.251808314 +0000 UTC m=+70.911794141" Jul 27 09:51:37.267120 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:51:37.267069 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gx68r" podStartSLOduration=66.557605456 podStartE2EDuration="1m11.267052267s" totalImagesPullingTime="4.709446811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:51:37.266520854 +0000 UTC m=+70.926506680" watchObservedRunningTime="2026-07-27 09:51:37.267052267 +0000 UTC m=+70.927038096" Jul 27 09:52:06.080276 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:52:06.080222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:52:06.080707 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:52:06.080341 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:52:06.080707 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:52:06.080402 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:53:10.080388399 +0000 UTC m=+163.740374204 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:52:08.242157 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:52:08.242124 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gx68r" Jul 27 09:52:35.572694 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:52:35.572642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:52:35.573291 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:52:35.572843 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:52:35.573291 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:52:35.572951 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:37.572930747 +0000 UTC m=+251.232916569 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : secret "metrics-daemon-secret" not found Jul 27 09:53:05.257456 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:53:05.257403 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rhjr2" podUID="63b086bd-8aa3-4928-bcca-82e1fce413ec" Jul 27 09:53:05.447539 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:05.447504 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rhjr2" Jul 27 09:53:06.831549 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:53:06.831510 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:53:10.104587 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:10.104551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:53:10.104993 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:53:10.104710 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:53:10.104993 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:53:10.104795 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls podName:63b086bd-8aa3-4928-bcca-82e1fce413ec nodeName:}" failed. No retries permitted until 2026-07-27 09:55:12.104776665 +0000 UTC m=+285.764762472 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls") pod "dns-default-rhjr2" (UID: "63b086bd-8aa3-4928-bcca-82e1fce413ec") : secret "dns-default-metrics-tls" not found Jul 27 09:53:20.481496 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:20.481465 2581 generic.go:356] "Generic (PLEG): container finished" podID="9878a111-31b9-4522-9505-df02bcd6451b" containerID="e7fbea2538c9a038490c116ed33014f6097def69ba8fdd8e31f592e8d138ef30" exitCode=255 Jul 27 09:53:20.481909 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:20.481531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" event={"ID":"9878a111-31b9-4522-9505-df02bcd6451b","Type":"ContainerDied","Data":"e7fbea2538c9a038490c116ed33014f6097def69ba8fdd8e31f592e8d138ef30"} Jul 27 09:53:20.486997 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:20.486980 2581 scope.go:117] "RemoveContainer" containerID="e7fbea2538c9a038490c116ed33014f6097def69ba8fdd8e31f592e8d138ef30" Jul 27 09:53:20.810786 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:20.810736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:53:21.485269 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:53:21.485239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" event={"ID":"9878a111-31b9-4522-9505-df02bcd6451b","Type":"ContainerStarted","Data":"8d15797d1835bc0fc7d05fe9023271c9b626b1f3bf6a026a25d6bbcbf03d31ea"} Jul 27 09:54:27.045973 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.045936 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b4cff98b7-525zf"] Jul 27 09:54:27.047925 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.047899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.049068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.049042 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c875c489c-zjmxv"] Jul 27 09:54:27.050672 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.050648 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t8fqn\"" Jul 27 09:54:27.050815 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.050673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.050815 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.050693 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 27 09:54:27.050815 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.050684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.050815 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.050738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 27 09:54:27.051975 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.051961 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 27 09:54:27.051975 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.051970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 27 09:54:27.052057 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.051978 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.053058 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.053038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 09:54:27.053284 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.053267 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 09:54:27.054554 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.054537 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 09:54:27.055281 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.055251 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qft4\"" Jul 27 09:54:27.059042 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.059022 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 09:54:27.065788 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.065769 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b4cff98b7-525zf"] Jul 27 09:54:27.069595 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.069576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c875c489c-zjmxv"] Jul 27 09:54:27.106498 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-certificates\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106596 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106527 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-trusted-ca\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106596 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-image-registry-private-configuration\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106596 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-installation-pull-secrets\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-bound-sa-token\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-default-certificate\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6lb9\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-kube-api-access-b6lb9\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-stats-auth\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.106780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4202ae2d-8718-4291-9e37-8c92ce9480ce-ca-trust-extracted\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.107017 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzr7p\" (UniqueName: \"kubernetes.io/projected/f17bd644-f209-44aa-a389-e22dcbb6b589-kube-api-access-gzr7p\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.107017 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.106804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.137703 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.137684 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97"] Jul 27 09:54:27.139466 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.139452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" Jul 27 09:54:27.142355 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.142333 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf"] Jul 27 09:54:27.142474 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.142430 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pntkn\"" Jul 27 09:54:27.144004 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.143989 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724"] Jul 27 09:54:27.144129 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.144115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.145587 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.145573 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.148487 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.148468 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 27 09:54:27.148586 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.148560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 27 09:54:27.148586 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.148565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.148737 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.148665 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.148879 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.148864 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 27 09:54:27.149041 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.149029 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:54:27.149128 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.149079 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 27 09:54:27.149197 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.149127 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wz42b\"" Jul 27 09:54:27.149987 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.149972 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 27 09:54:27.151660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.151644 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-485dx\"" Jul 27 09:54:27.155037 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.155019 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf"] Jul 27 09:54:27.160145 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.160124 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724"] Jul 27 09:54:27.161063 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.161043 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97"] Jul 27 09:54:27.207038 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-trusted-ca\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207132 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-bound-sa-token\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207132 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5f2\" (UniqueName: \"kubernetes.io/projected/871a1665-96b2-41d6-8f38-570250588702-kube-api-access-4w5f2\") pod \"network-check-source-7d88cb55d8-5zh97\" (UID: \"871a1665-96b2-41d6-8f38-570250588702\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" Jul 27 09:54:27.207132 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jdsg\" (UniqueName: \"kubernetes.io/projected/411208fb-3108-4137-add3-ed8820fe90b7-kube-api-access-2jdsg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.207132 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-default-certificate\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.207330 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6lb9\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-kube-api-access-b6lb9\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207330 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/411208fb-3108-4137-add3-ed8820fe90b7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.207330 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4202ae2d-8718-4291-9e37-8c92ce9480ce-ca-trust-extracted\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207330 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.207330 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.207304 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:54:27.207578 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.207367 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:27.707347126 +0000 UTC m=+241.367332931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : secret "router-metrics-certs-default" not found Jul 27 09:54:27.207578 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7be59250-e839-442a-93c7-1ca86793dc51-config\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.207578 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-image-registry-private-configuration\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207578 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207578 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-installation-pull-secrets\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.207578 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn7hw\" (UniqueName: \"kubernetes.io/projected/7be59250-e839-442a-93c7-1ca86793dc51-kube-api-access-jn7hw\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.207610 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7be59250-e839-442a-93c7-1ca86793dc51-serving-cert\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4202ae2d-8718-4291-9e37-8c92ce9480ce-ca-trust-extracted\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/411208fb-3108-4137-add3-ed8820fe90b7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.207623 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c875c489c-zjmxv: secret "image-registry-tls" not found Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.207705 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls podName:4202ae2d-8718-4291-9e37-8c92ce9480ce nodeName:}" failed. No retries permitted until 2026-07-27 09:54:27.707691095 +0000 UTC m=+241.367676899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls") pod "image-registry-c875c489c-zjmxv" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce") : secret "image-registry-tls" not found Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-stats-auth\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.207812 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:27.707800465 +0000 UTC m=+241.367786293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : configmap references non-existent config key: service-ca.crt Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzr7p\" (UniqueName: \"kubernetes.io/projected/f17bd644-f209-44aa-a389-e22dcbb6b589-kube-api-access-gzr7p\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.207855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-certificates\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.208068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.208069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-trusted-ca\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.208661 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.208500 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-certificates\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.210068 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.210037 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-default-certificate\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.210286 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.210269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-image-registry-private-configuration\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.210286 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.210279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-stats-auth\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.210464 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.210275 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-installation-pull-secrets\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.217902 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.217880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-bound-sa-token\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.218375 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.218348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzr7p\" (UniqueName: \"kubernetes.io/projected/f17bd644-f209-44aa-a389-e22dcbb6b589-kube-api-access-gzr7p\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.219035 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.219016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6lb9\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-kube-api-access-b6lb9\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.308301 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn7hw\" (UniqueName: \"kubernetes.io/projected/7be59250-e839-442a-93c7-1ca86793dc51-kube-api-access-jn7hw\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.308301 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7be59250-e839-442a-93c7-1ca86793dc51-serving-cert\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.308301 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/411208fb-3108-4137-add3-ed8820fe90b7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.308487 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5f2\" (UniqueName: \"kubernetes.io/projected/871a1665-96b2-41d6-8f38-570250588702-kube-api-access-4w5f2\") pod \"network-check-source-7d88cb55d8-5zh97\" (UID: \"871a1665-96b2-41d6-8f38-570250588702\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" Jul 27 09:54:27.308487 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jdsg\" (UniqueName: \"kubernetes.io/projected/411208fb-3108-4137-add3-ed8820fe90b7-kube-api-access-2jdsg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.308487 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/411208fb-3108-4137-add3-ed8820fe90b7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.308606 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7be59250-e839-442a-93c7-1ca86793dc51-config\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.309006 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.308983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/411208fb-3108-4137-add3-ed8820fe90b7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.309092 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.309018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7be59250-e839-442a-93c7-1ca86793dc51-config\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.310324 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.310303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/411208fb-3108-4137-add3-ed8820fe90b7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.310517 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.310500 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7be59250-e839-442a-93c7-1ca86793dc51-serving-cert\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.320329 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.320306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5f2\" (UniqueName: \"kubernetes.io/projected/871a1665-96b2-41d6-8f38-570250588702-kube-api-access-4w5f2\") pod \"network-check-source-7d88cb55d8-5zh97\" (UID: \"871a1665-96b2-41d6-8f38-570250588702\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" Jul 27 09:54:27.322542 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.322517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jdsg\" (UniqueName: \"kubernetes.io/projected/411208fb-3108-4137-add3-ed8820fe90b7-kube-api-access-2jdsg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf\" (UID: \"411208fb-3108-4137-add3-ed8820fe90b7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.322620 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.322608 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn7hw\" (UniqueName: \"kubernetes.io/projected/7be59250-e839-442a-93c7-1ca86793dc51-kube-api-access-jn7hw\") pod \"service-ca-operator-5d6c75f84f-qg724\" (UID: \"7be59250-e839-442a-93c7-1ca86793dc51\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.449353 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.449333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" Jul 27 09:54:27.455700 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.455529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" Jul 27 09:54:27.462284 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.462266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" Jul 27 09:54:27.588342 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.588273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97"] Jul 27 09:54:27.591403 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:27.591385 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871a1665_96b2_41d6_8f38_570250588702.slice/crio-899c10945aa58623483eaa4b3d7cc695e969d7b64a78e64c236fdd825f5ce4b1 WatchSource:0}: Error finding container 899c10945aa58623483eaa4b3d7cc695e969d7b64a78e64c236fdd825f5ce4b1: Status 404 returned error can't find the container with id 899c10945aa58623483eaa4b3d7cc695e969d7b64a78e64c236fdd825f5ce4b1 Jul 27 09:54:27.640436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.640413 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" event={"ID":"871a1665-96b2-41d6-8f38-570250588702","Type":"ContainerStarted","Data":"30a734e5c2a85770a5a505043af0f8f36353997ad176660c9d124edbc334fce3"} Jul 27 09:54:27.640520 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.640455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" event={"ID":"871a1665-96b2-41d6-8f38-570250588702","Type":"ContainerStarted","Data":"899c10945aa58623483eaa4b3d7cc695e969d7b64a78e64c236fdd825f5ce4b1"} Jul 27 09:54:27.712815 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.712786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.712960 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.712834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:27.712960 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.712862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:27.712960 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.712926 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:54:27.713114 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.712992 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:28.712974235 +0000 UTC m=+242.372960041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : configmap references non-existent config key: service-ca.crt Jul 27 09:54:27.713114 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.713011 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:28.713002808 +0000 UTC m=+242.372988613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : secret "router-metrics-certs-default" not found Jul 27 09:54:27.713114 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.713038 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:54:27.713114 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.713058 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c875c489c-zjmxv: secret "image-registry-tls" not found Jul 27 09:54:27.713114 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:27.713114 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls podName:4202ae2d-8718-4291-9e37-8c92ce9480ce nodeName:}" failed. No retries permitted until 2026-07-27 09:54:28.713094972 +0000 UTC m=+242.373080790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls") pod "image-registry-c875c489c-zjmxv" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce") : secret "image-registry-tls" not found Jul 27 09:54:27.812739 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.812195 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5zh97" podStartSLOduration=0.812173176 podStartE2EDuration="812.173176ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:27.666361062 +0000 UTC m=+241.326347088" watchObservedRunningTime="2026-07-27 09:54:27.812173176 +0000 UTC m=+241.472159005" Jul 27 09:54:27.813149 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.813120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf"] Jul 27 09:54:27.814094 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:27.814075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724"] Jul 27 09:54:27.816423 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:27.816403 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411208fb_3108_4137_add3_ed8820fe90b7.slice/crio-10009b90547284d6fc8143391116c3229cf9fce195f0902668ef513e0e3cdf54 WatchSource:0}: Error finding container 10009b90547284d6fc8143391116c3229cf9fce195f0902668ef513e0e3cdf54: Status 404 returned error can't find the container with id 10009b90547284d6fc8143391116c3229cf9fce195f0902668ef513e0e3cdf54 Jul 27 09:54:27.817173 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:27.817153 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be59250_e839_442a_93c7_1ca86793dc51.slice/crio-5533ba9e28d56fc0ce1025edce222fcce87f8105b75f29b4ce045126cc8f354a WatchSource:0}: Error finding container 5533ba9e28d56fc0ce1025edce222fcce87f8105b75f29b4ce045126cc8f354a: Status 404 returned error can't find the container with id 5533ba9e28d56fc0ce1025edce222fcce87f8105b75f29b4ce045126cc8f354a Jul 27 09:54:28.645296 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:28.645254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" event={"ID":"7be59250-e839-442a-93c7-1ca86793dc51","Type":"ContainerStarted","Data":"5533ba9e28d56fc0ce1025edce222fcce87f8105b75f29b4ce045126cc8f354a"} Jul 27 09:54:28.646574 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:28.646549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" event={"ID":"411208fb-3108-4137-add3-ed8820fe90b7","Type":"ContainerStarted","Data":"10009b90547284d6fc8143391116c3229cf9fce195f0902668ef513e0e3cdf54"} Jul 27 09:54:28.721426 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:28.721392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:28.721573 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:28.721481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:28.721573 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:28.721534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:28.721677 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:28.721579 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:30.721556573 +0000 UTC m=+244.381542380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : configmap references non-existent config key: service-ca.crt Jul 27 09:54:28.721677 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:28.721626 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:54:28.721677 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:28.721640 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c875c489c-zjmxv: secret "image-registry-tls" not found Jul 27 09:54:28.721850 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:28.721688 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls podName:4202ae2d-8718-4291-9e37-8c92ce9480ce nodeName:}" failed. No retries permitted until 2026-07-27 09:54:30.721670807 +0000 UTC m=+244.381656635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls") pod "image-registry-c875c489c-zjmxv" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce") : secret "image-registry-tls" not found Jul 27 09:54:28.721850 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:28.721701 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:54:28.721850 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:28.721767 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:30.721733541 +0000 UTC m=+244.381719347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : secret "router-metrics-certs-default" not found Jul 27 09:54:30.655329 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.655292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" event={"ID":"7be59250-e839-442a-93c7-1ca86793dc51","Type":"ContainerStarted","Data":"59f3799882d9c957a688aa6ca248e4166c9c62e6db0c1dece60d7f20553075d9"} Jul 27 09:54:30.656956 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.656930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" event={"ID":"411208fb-3108-4137-add3-ed8820fe90b7","Type":"ContainerStarted","Data":"d8dcf19f7892735a23943abf2ef0c7b6dddb91b624fd9280d7cc5c1526404204"} Jul 27 09:54:30.674564 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.674482 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" podStartSLOduration=1.069821629 podStartE2EDuration="3.674468797s" totalImagesPullingTime="2.604647168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:30.673206201 +0000 UTC m=+244.333192075" watchObservedRunningTime="2026-07-27 09:54:30.674468797 +0000 UTC m=+244.334454623" Jul 27 09:54:30.692991 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.692946 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" podStartSLOduration=1.087009972 podStartE2EDuration="3.692932245s" totalImagesPullingTime="2.605922273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:30.692376651 +0000 UTC m=+244.352362479" watchObservedRunningTime="2026-07-27 09:54:30.692932245 +0000 UTC m=+244.352918073" Jul 27 09:54:30.738922 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.738891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:30.739046 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:30.739026 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:54:30.739104 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:30.739095 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:34.739076419 +0000 UTC m=+248.399062237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : secret "router-metrics-certs-default" not found Jul 27 09:54:30.739167 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.739139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:30.739222 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:30.739171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:30.739276 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:30.739239 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:54:30.739276 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:30.739257 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c875c489c-zjmxv: secret "image-registry-tls" not found Jul 27 09:54:30.739385 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:30.739303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls podName:4202ae2d-8718-4291-9e37-8c92ce9480ce nodeName:}" failed. No retries permitted until 2026-07-27 09:54:34.739288857 +0000 UTC m=+248.399274680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls") pod "image-registry-c875c489c-zjmxv" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce") : secret "image-registry-tls" not found Jul 27 09:54:30.739535 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:30.739515 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:34.739500969 +0000 UTC m=+248.399486774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : configmap references non-existent config key: service-ca.crt Jul 27 09:54:31.460860 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.460821 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-972hc"] Jul 27 09:54:31.466657 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.466630 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.469685 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.469645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 09:54:31.470466 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.470446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dqlrd\"" Jul 27 09:54:31.470696 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.470665 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 09:54:31.470792 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.470770 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 09:54:31.470902 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.470866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 09:54:31.479484 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.479312 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-972hc"] Jul 27 09:54:31.544436 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.544411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8cc685e-6987-4a84-8c81-6b423cd7f452-data-volume\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.544551 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.544453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.544551 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.544531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8cc685e-6987-4a84-8c81-6b423cd7f452-crio-socket\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.544621 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.544559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lm2g\" (UniqueName: \"kubernetes.io/projected/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-api-access-5lm2g\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.544682 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.544660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645566 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.645523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8cc685e-6987-4a84-8c81-6b423cd7f452-crio-socket\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645696 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.645570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lm2g\" (UniqueName: \"kubernetes.io/projected/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-api-access-5lm2g\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645696 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.645635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645696 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.645647 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8cc685e-6987-4a84-8c81-6b423cd7f452-crio-socket\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645696 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.645691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8cc685e-6987-4a84-8c81-6b423cd7f452-data-volume\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645906 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.645726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.645906 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:31.645782 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:31.645906 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:31.645857 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:31.645906 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:31.645862 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:32.145841171 +0000 UTC m=+245.805826978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : configmap "kube-rbac-proxy" not found Jul 27 09:54:31.646099 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:31.645921 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:32.145905364 +0000 UTC m=+245.805891174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:31.646206 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.646188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8cc685e-6987-4a84-8c81-6b423cd7f452-data-volume\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:31.656184 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:31.656161 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lm2g\" (UniqueName: \"kubernetes.io/projected/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-api-access-5lm2g\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:32.150597 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:32.150467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:32.150838 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:32.150615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:32.150838 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:32.150729 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:32.150838 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:32.150828 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:33.150806942 +0000 UTC m=+246.810792762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : configmap "kube-rbac-proxy" not found Jul 27 09:54:32.151171 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:32.151142 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:32.151284 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:32.151208 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:33.151191853 +0000 UTC m=+246.811177662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:33.160718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:33.160686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:33.161171 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:33.160731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:33.161171 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:33.160826 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:33.161171 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:33.160892 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:35.160875451 +0000 UTC m=+248.820861274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : configmap "kube-rbac-proxy" not found Jul 27 09:54:33.161171 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:33.160904 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:33.161171 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:33.160985 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:35.160972219 +0000 UTC m=+248.820958024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:33.663282 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:33.663252 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cmfkm_7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29/dns-node-resolver/0.log" Jul 27 09:54:34.267830 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.267803 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5c5xt_0463c002-a8e0-4385-90d4-fb04d302c0be/node-ca/0.log" Jul 27 09:54:34.279318 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.279294 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bphfl"] Jul 27 09:54:34.282372 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.282359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.284845 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.284826 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 09:54:34.285735 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.285704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 09:54:34.285735 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.285704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jbzf5\"" Jul 27 09:54:34.285735 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.285738 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 09:54:34.285943 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.285706 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 09:54:34.291483 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.291464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bphfl"] Jul 27 09:54:34.367606 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.367581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae016158-4dc3-4366-be26-fe01ded4b24f-signing-cabundle\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.367720 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.367625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64vb\" (UniqueName: \"kubernetes.io/projected/ae016158-4dc3-4366-be26-fe01ded4b24f-kube-api-access-r64vb\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.367720 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.367702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae016158-4dc3-4366-be26-fe01ded4b24f-signing-key\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.468943 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.468913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae016158-4dc3-4366-be26-fe01ded4b24f-signing-cabundle\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.469053 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.468977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64vb\" (UniqueName: \"kubernetes.io/projected/ae016158-4dc3-4366-be26-fe01ded4b24f-kube-api-access-r64vb\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.469053 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.469024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae016158-4dc3-4366-be26-fe01ded4b24f-signing-key\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.469663 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.469644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae016158-4dc3-4366-be26-fe01ded4b24f-signing-cabundle\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.471500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.471482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae016158-4dc3-4366-be26-fe01ded4b24f-signing-key\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.478057 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.478030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64vb\" (UniqueName: \"kubernetes.io/projected/ae016158-4dc3-4366-be26-fe01ded4b24f-kube-api-access-r64vb\") pod \"service-ca-658d7b7c78-bphfl\" (UID: \"ae016158-4dc3-4366-be26-fe01ded4b24f\") " pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.591433 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.591370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" Jul 27 09:54:34.715375 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.715348 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-bphfl"] Jul 27 09:54:34.718089 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:34.718066 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae016158_4dc3_4366_be26_fe01ded4b24f.slice/crio-5b631734d33ed34f0400e5e94abcfd140d6911b7bba29e5f962530383e39a871 WatchSource:0}: Error finding container 5b631734d33ed34f0400e5e94abcfd140d6911b7bba29e5f962530383e39a871: Status 404 returned error can't find the container with id 5b631734d33ed34f0400e5e94abcfd140d6911b7bba29e5f962530383e39a871 Jul 27 09:54:34.771388 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.771331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:34.771388 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.771373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:34.771501 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:34.771394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:34.771501 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:34.771464 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:54:34.771501 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:34.771470 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 09:54:34.771501 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:34.771491 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c875c489c-zjmxv: secret "image-registry-tls" not found Jul 27 09:54:34.771648 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:34.771515 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:42.771500893 +0000 UTC m=+256.431486702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : secret "router-metrics-certs-default" not found Jul 27 09:54:34.771648 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:34.771540 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls podName:4202ae2d-8718-4291-9e37-8c92ce9480ce nodeName:}" failed. No retries permitted until 2026-07-27 09:54:42.771523538 +0000 UTC m=+256.431509345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls") pod "image-registry-c875c489c-zjmxv" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce") : secret "image-registry-tls" not found Jul 27 09:54:34.771648 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:34.771558 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle podName:f17bd644-f209-44aa-a389-e22dcbb6b589 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:42.771548334 +0000 UTC m=+256.431534140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle") pod "router-default-5b4cff98b7-525zf" (UID: "f17bd644-f209-44aa-a389-e22dcbb6b589") : configmap references non-existent config key: service-ca.crt Jul 27 09:54:35.063734 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:35.063696 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c4mkz_5ece7cf3-e32d-48e0-8574-0f28133ca284/serve-healthcheck-canary/0.log" Jul 27 09:54:35.175009 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:35.174980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:35.175188 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:35.175112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:35.175188 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:35.175122 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:35.175188 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:35.175174 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:39.175159269 +0000 UTC m=+252.835145075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:35.175344 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:35.175210 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:35.175344 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:35.175262 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:39.175246579 +0000 UTC m=+252.835232403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : configmap "kube-rbac-proxy" not found Jul 27 09:54:35.675311 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:35.675279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" event={"ID":"ae016158-4dc3-4366-be26-fe01ded4b24f","Type":"ContainerStarted","Data":"74dae222d3ceb1f992626c4af517fed44fce80b47d4db9124ab2393443b47a0f"} Jul 27 09:54:35.675685 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:35.675335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" event={"ID":"ae016158-4dc3-4366-be26-fe01ded4b24f","Type":"ContainerStarted","Data":"5b631734d33ed34f0400e5e94abcfd140d6911b7bba29e5f962530383e39a871"} Jul 27 09:54:37.596462 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:37.596418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:54:37.596862 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:37.596588 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:54:37.596862 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:37.596673 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs podName:b6db3599-f13b-41f9-9bcb-692774d28e10 nodeName:}" failed. No retries permitted until 2026-07-27 09:56:39.596652206 +0000 UTC m=+373.256638018 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs") pod "network-metrics-daemon-zvq9q" (UID: "b6db3599-f13b-41f9-9bcb-692774d28e10") : secret "metrics-daemon-secret" not found Jul 27 09:54:39.207506 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:39.207467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:39.207964 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:39.207599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:39.207964 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:39.207653 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:54:39.207964 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:39.207704 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:54:39.207964 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:39.207764 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:47.207721069 +0000 UTC m=+260.867706880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : secret "insights-runtime-extractor-tls" not found Jul 27 09:54:39.207964 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:54:39.207790 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm podName:b8cc685e-6987-4a84-8c81-6b423cd7f452 nodeName:}" failed. No retries permitted until 2026-07-27 09:54:47.207772164 +0000 UTC m=+260.867757989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm") pod "insights-runtime-extractor-972hc" (UID: "b8cc685e-6987-4a84-8c81-6b423cd7f452") : configmap "kube-rbac-proxy" not found Jul 27 09:54:42.838787 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.838730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:42.839252 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.838819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:42.839252 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.838846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:42.839518 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.839495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f17bd644-f209-44aa-a389-e22dcbb6b589-service-ca-bundle\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:42.841171 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.841140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f17bd644-f209-44aa-a389-e22dcbb6b589-metrics-certs\") pod \"router-default-5b4cff98b7-525zf\" (UID: \"f17bd644-f209-44aa-a389-e22dcbb6b589\") " pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:42.841269 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.841196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"image-registry-c875c489c-zjmxv\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:42.958589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.958563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:42.963427 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:42.963408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:43.107699 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.107596 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-bphfl" podStartSLOduration=9.107578681 podStartE2EDuration="9.107578681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:35.693195218 +0000 UTC m=+249.353181045" watchObservedRunningTime="2026-07-27 09:54:43.107578681 +0000 UTC m=+256.767564509" Jul 27 09:54:43.107948 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.107926 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b4cff98b7-525zf"] Jul 27 09:54:43.112320 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:43.112294 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17bd644_f209_44aa_a389_e22dcbb6b589.slice/crio-4517ff25ef6af11e66aa3fb811451dd53c8b961b160f91768aa00353f4b3a996 WatchSource:0}: Error finding container 4517ff25ef6af11e66aa3fb811451dd53c8b961b160f91768aa00353f4b3a996: Status 404 returned error can't find the container with id 4517ff25ef6af11e66aa3fb811451dd53c8b961b160f91768aa00353f4b3a996 Jul 27 09:54:43.131583 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.131560 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c875c489c-zjmxv"] Jul 27 09:54:43.142998 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:43.142976 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4202ae2d_8718_4291_9e37_8c92ce9480ce.slice/crio-5d19281b864ea84c3d2b8d89b4cd1cefd35ed7d8f620682c2b4e8db0d02264bc WatchSource:0}: Error finding container 5d19281b864ea84c3d2b8d89b4cd1cefd35ed7d8f620682c2b4e8db0d02264bc: Status 404 returned error can't find the container with id 5d19281b864ea84c3d2b8d89b4cd1cefd35ed7d8f620682c2b4e8db0d02264bc Jul 27 09:54:43.701371 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.701331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b4cff98b7-525zf" event={"ID":"f17bd644-f209-44aa-a389-e22dcbb6b589","Type":"ContainerStarted","Data":"8549a3ae7893594b1266c132182346427862dfa9966b4ed24229dae3d65f8fdc"} Jul 27 09:54:43.701554 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.701382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b4cff98b7-525zf" event={"ID":"f17bd644-f209-44aa-a389-e22dcbb6b589","Type":"ContainerStarted","Data":"4517ff25ef6af11e66aa3fb811451dd53c8b961b160f91768aa00353f4b3a996"} Jul 27 09:54:43.702786 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.702762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" event={"ID":"4202ae2d-8718-4291-9e37-8c92ce9480ce","Type":"ContainerStarted","Data":"351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea"} Jul 27 09:54:43.702896 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.702802 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:54:43.702896 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.702815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" event={"ID":"4202ae2d-8718-4291-9e37-8c92ce9480ce","Type":"ContainerStarted","Data":"5d19281b864ea84c3d2b8d89b4cd1cefd35ed7d8f620682c2b4e8db0d02264bc"} Jul 27 09:54:43.735600 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.735554 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b4cff98b7-525zf" podStartSLOduration=16.735539906 podStartE2EDuration="16.735539906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:43.734941076 +0000 UTC m=+257.394926914" watchObservedRunningTime="2026-07-27 09:54:43.735539906 +0000 UTC m=+257.395525732" Jul 27 09:54:43.762487 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.762448 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" podStartSLOduration=16.762435565 podStartE2EDuration="16.762435565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:43.762165039 +0000 UTC m=+257.422150865" watchObservedRunningTime="2026-07-27 09:54:43.762435565 +0000 UTC m=+257.422421392" Jul 27 09:54:43.958865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.958795 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:43.961209 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:43.961190 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:44.706668 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:44.706638 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:44.707759 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:44.707721 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b4cff98b7-525zf" Jul 27 09:54:47.276838 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.276811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:47.277305 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.276852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:47.277456 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.277433 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8cc685e-6987-4a84-8c81-6b423cd7f452-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:47.279272 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.279254 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8cc685e-6987-4a84-8c81-6b423cd7f452-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-972hc\" (UID: \"b8cc685e-6987-4a84-8c81-6b423cd7f452\") " pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:47.376132 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.376096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-972hc" Jul 27 09:54:47.511895 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.511861 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-972hc"] Jul 27 09:54:47.514672 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:47.514641 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8cc685e_6987_4a84_8c81_6b423cd7f452.slice/crio-d2383fff0086dfc4da14264e6d648e4037f2a770615ae778a8f1d6f3a5c421fe WatchSource:0}: Error finding container d2383fff0086dfc4da14264e6d648e4037f2a770615ae778a8f1d6f3a5c421fe: Status 404 returned error can't find the container with id d2383fff0086dfc4da14264e6d648e4037f2a770615ae778a8f1d6f3a5c421fe Jul 27 09:54:47.720658 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:47.720615 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-972hc" event={"ID":"b8cc685e-6987-4a84-8c81-6b423cd7f452","Type":"ContainerStarted","Data":"d2383fff0086dfc4da14264e6d648e4037f2a770615ae778a8f1d6f3a5c421fe"} Jul 27 09:54:52.739222 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:52.739188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-972hc" event={"ID":"b8cc685e-6987-4a84-8c81-6b423cd7f452","Type":"ContainerStarted","Data":"371cfe1cce2b8bdef32e6121d5f13bfe75a373d21acf6b35bbffa95df019179c"} Jul 27 09:54:55.354413 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.353543 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c875c489c-zjmxv"] Jul 27 09:54:55.396272 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.396239 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c54f65d49-9r94f"] Jul 27 09:54:55.412188 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.412116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.415263 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.415235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c54f65d49-9r94f"] Jul 27 09:54:55.552255 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p62d2\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-kube-api-access-p62d2\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552437 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-bound-sa-token\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552437 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-ca-trust-extracted\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552437 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-image-registry-private-configuration\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552614 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-registry-certificates\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552614 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-registry-tls\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552614 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-trusted-ca\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.552614 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.552532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-installation-pull-secrets\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653072 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.652983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-image-registry-private-configuration\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653072 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-registry-certificates\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653271 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-registry-tls\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653271 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-trusted-ca\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653271 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-installation-pull-secrets\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653271 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p62d2\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-kube-api-access-p62d2\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653526 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-bound-sa-token\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.653526 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.653369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-ca-trust-extracted\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.654398 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.654370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-ca-trust-extracted\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.654906 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.654847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-trusted-ca\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.655132 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.655073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-registry-certificates\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.656084 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.656027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-image-registry-private-configuration\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.656084 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.656031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-installation-pull-secrets\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.656583 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.656561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-registry-tls\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.665475 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.665422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p62d2\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-kube-api-access-p62d2\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.666624 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.666603 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/179a9bd8-0a2c-4c1e-859a-7b3f9f045dce-bound-sa-token\") pod \"image-registry-7c54f65d49-9r94f\" (UID: \"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce\") " pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:55.727055 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:55.727033 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:56.712772 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:56.712725 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c54f65d49-9r94f"] Jul 27 09:54:56.715077 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:54:56.715052 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179a9bd8_0a2c_4c1e_859a_7b3f9f045dce.slice/crio-c27ff4aa769bae4cc0b8e600c13ddeb35f4f8fdc591167a6486fb28c3febe94c WatchSource:0}: Error finding container c27ff4aa769bae4cc0b8e600c13ddeb35f4f8fdc591167a6486fb28c3febe94c: Status 404 returned error can't find the container with id c27ff4aa769bae4cc0b8e600c13ddeb35f4f8fdc591167a6486fb28c3febe94c Jul 27 09:54:56.762517 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:56.762486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-972hc" event={"ID":"b8cc685e-6987-4a84-8c81-6b423cd7f452","Type":"ContainerStarted","Data":"7f90825689eeb0e513c6818b43e3f82dc1ae233a9d1900eaff238c144fac9cd2"} Jul 27 09:54:56.764041 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:56.764021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" event={"ID":"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce","Type":"ContainerStarted","Data":"c27ff4aa769bae4cc0b8e600c13ddeb35f4f8fdc591167a6486fb28c3febe94c"} Jul 27 09:54:57.769416 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:57.769374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" event={"ID":"179a9bd8-0a2c-4c1e-859a-7b3f9f045dce","Type":"ContainerStarted","Data":"ce3e4b434380583a22c6f9203fdc6286769af66f9607e57efb9b0534e6f996cd"} Jul 27 09:54:57.769896 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:57.769533 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:54:57.796944 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:54:57.796896 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" podStartSLOduration=2.796875965 podStartE2EDuration="2.796875965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:54:57.796737873 +0000 UTC m=+271.456723701" watchObservedRunningTime="2026-07-27 09:54:57.796875965 +0000 UTC m=+271.456861794" Jul 27 09:55:00.781880 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:00.781843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-972hc" event={"ID":"b8cc685e-6987-4a84-8c81-6b423cd7f452","Type":"ContainerStarted","Data":"cd71aeedfb3ff67a3d9973d43a08e2ba82ee5d1de6f2c81abfc2926b3c906589"} Jul 27 09:55:00.804210 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:00.804165 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-972hc" podStartSLOduration=17.38765824 podStartE2EDuration="29.804148292s" totalImagesPullingTime="12.416490052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:54:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:00.803302336 +0000 UTC m=+274.463288163" watchObservedRunningTime="2026-07-27 09:55:00.804148292 +0000 UTC m=+274.464134118" Jul 27 09:55:03.401731 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.401698 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4jq55"] Jul 27 09:55:03.407169 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.407149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.410303 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.410262 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 09:55:03.411371 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.411354 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 09:55:03.411527 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.411410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 09:55:03.411597 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.411410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 09:55:03.411650 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.411443 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 09:55:03.411712 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.411467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzqw7\"" Jul 27 09:55:03.411778 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.411582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 09:55:03.515463 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515604 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515604 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-sys\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515711 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-root\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515711 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-tls\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515828 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-textfile\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515828 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-wtmp\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515828 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4505b5-df09-47cf-acf5-bdb21c197595-metrics-client-ca\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.515828 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.515826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfnf\" (UniqueName: \"kubernetes.io/projected/4e4505b5-df09-47cf-acf5-bdb21c197595-kube-api-access-qnfnf\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616529 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfnf\" (UniqueName: \"kubernetes.io/projected/4e4505b5-df09-47cf-acf5-bdb21c197595-kube-api-access-qnfnf\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616704 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616704 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616704 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-sys\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616704 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-root\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616704 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-tls\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616977 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-textfile\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616977 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-wtmp\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616977 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.616788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4505b5-df09-47cf-acf5-bdb21c197595-metrics-client-ca\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.616977 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:03.616970 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 09:55:03.617175 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:03.617039 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-tls podName:4e4505b5-df09-47cf-acf5-bdb21c197595 nodeName:}" failed. No retries permitted until 2026-07-27 09:55:04.117020108 +0000 UTC m=+277.777005920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-tls") pod "node-exporter-4jq55" (UID: "4e4505b5-df09-47cf-acf5-bdb21c197595") : secret "node-exporter-tls" not found Jul 27 09:55:03.617249 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.617231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-sys\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.617296 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.617285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-root\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.617296 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.617285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.617440 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.617423 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-wtmp\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.617565 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.617548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-textfile\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.617615 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.617573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4505b5-df09-47cf-acf5-bdb21c197595-metrics-client-ca\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.619146 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.619117 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:03.628140 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:03.628111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfnf\" (UniqueName: \"kubernetes.io/projected/4e4505b5-df09-47cf-acf5-bdb21c197595-kube-api-access-qnfnf\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:04.120480 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:04.120450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-tls\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:04.122933 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:04.122905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e4505b5-df09-47cf-acf5-bdb21c197595-node-exporter-tls\") pod \"node-exporter-4jq55\" (UID: \"4e4505b5-df09-47cf-acf5-bdb21c197595\") " pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:04.317997 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:04.317962 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jq55" Jul 27 09:55:04.329023 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:55:04.328998 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4505b5_df09_47cf_acf5_bdb21c197595.slice/crio-5059fee20e7cf4c557d3e26beaef22e06405a1c0f75f6227a8193ca2881cbe2e WatchSource:0}: Error finding container 5059fee20e7cf4c557d3e26beaef22e06405a1c0f75f6227a8193ca2881cbe2e: Status 404 returned error can't find the container with id 5059fee20e7cf4c557d3e26beaef22e06405a1c0f75f6227a8193ca2881cbe2e Jul 27 09:55:04.795334 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:04.795298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jq55" event={"ID":"4e4505b5-df09-47cf-acf5-bdb21c197595","Type":"ContainerStarted","Data":"5059fee20e7cf4c557d3e26beaef22e06405a1c0f75f6227a8193ca2881cbe2e"} Jul 27 09:55:05.358921 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:05.358882 2581 patch_prober.go:28] interesting pod/image-registry-c875c489c-zjmxv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 09:55:05.359077 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:05.358931 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" podUID="4202ae2d-8718-4291-9e37-8c92ce9480ce" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 09:55:06.803608 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:06.803574 2581 generic.go:356] "Generic (PLEG): container finished" podID="4e4505b5-df09-47cf-acf5-bdb21c197595" containerID="c8fbb70a338b9a123b93ce1c7db7e842647a234071204750aebedbed89fef8ef" exitCode=0 Jul 27 09:55:06.804002 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:06.803652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jq55" event={"ID":"4e4505b5-df09-47cf-acf5-bdb21c197595","Type":"ContainerDied","Data":"c8fbb70a338b9a123b93ce1c7db7e842647a234071204750aebedbed89fef8ef"} Jul 27 09:55:07.809306 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:07.809270 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jq55" event={"ID":"4e4505b5-df09-47cf-acf5-bdb21c197595","Type":"ContainerStarted","Data":"8bf4970d9305086ab8b363719f09ee6cf679aa023c57dbaa9edaf1431e287109"} Jul 27 09:55:07.809660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:07.809332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jq55" event={"ID":"4e4505b5-df09-47cf-acf5-bdb21c197595","Type":"ContainerStarted","Data":"480ce123d07847ed65d03fad6f65142e70d12e52a2e8d184ece5da93ad3343f2"} Jul 27 09:55:07.837590 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:07.837542 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4jq55" podStartSLOduration=3.195974108 podStartE2EDuration="4.837525075s" totalImagesPullingTime="1.571123427s" totalInitContainerRuntime="70.42754ms" isStatefulPod=true podCreationTimestamp="2026-07-27 09:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:07.836179932 +0000 UTC m=+281.496165760" watchObservedRunningTime="2026-07-27 09:55:07.837525075 +0000 UTC m=+281.497510905" Jul 27 09:55:08.155050 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.154979 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dcd5c7c9-htrm5"] Jul 27 09:55:08.158019 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.158005 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.162163 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.162139 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 09:55:08.162163 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.162164 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 09:55:08.162598 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.162583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 09:55:08.164840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.164820 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 09:55:08.164977 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.164957 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 09:55:08.165128 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.165109 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kwfvc\"" Jul 27 09:55:08.165205 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.165130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 09:55:08.165485 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.165472 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 09:55:08.174791 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.174774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 09:55:08.177947 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.177928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dcd5c7c9-htrm5"] Jul 27 09:55:08.255389 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-config\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.255524 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-serving-cert\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.255524 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-trusted-ca-bundle\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.255609 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-oauth-serving-cert\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.255609 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-oauth-config\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.255682 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcblc\" (UniqueName: \"kubernetes.io/projected/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-kube-api-access-xcblc\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.255682 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.255663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-service-ca\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.356722 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.356686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-trusted-ca-bundle\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.356881 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.356774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-oauth-serving-cert\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.356881 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.356813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-oauth-config\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.356881 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.356839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcblc\" (UniqueName: \"kubernetes.io/projected/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-kube-api-access-xcblc\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.356881 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.356866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-service-ca\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.357178 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.357158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-config\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.357297 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.357278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-serving-cert\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.357621 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.357594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-oauth-serving-cert\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.357718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.357618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-trusted-ca-bundle\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.357860 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.357838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-config\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.358024 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.357878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-service-ca\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.359452 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.359429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-oauth-config\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.359641 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.359624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-serving-cert\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.369792 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.369771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcblc\" (UniqueName: \"kubernetes.io/projected/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-kube-api-access-xcblc\") pod \"console-56dcd5c7c9-htrm5\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.448490 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:08.448462 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rhjr2" podUID="63b086bd-8aa3-4928-bcca-82e1fce413ec" Jul 27 09:55:08.467726 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.467700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:08.617186 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.617153 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dcd5c7c9-htrm5"] Jul 27 09:55:08.619860 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:55:08.619838 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb6df92_c668_43dd_ae9e_38c07bb1eb38.slice/crio-134086ade253080bd866135f65b84010b4a323c28397005b7ccd02801dfa7b31 WatchSource:0}: Error finding container 134086ade253080bd866135f65b84010b4a323c28397005b7ccd02801dfa7b31: Status 404 returned error can't find the container with id 134086ade253080bd866135f65b84010b4a323c28397005b7ccd02801dfa7b31 Jul 27 09:55:08.814363 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.814302 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rhjr2" Jul 27 09:55:08.815225 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:08.815199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dcd5c7c9-htrm5" event={"ID":"5eb6df92-c668-43dd-ae9e-38c07bb1eb38","Type":"ContainerStarted","Data":"134086ade253080bd866135f65b84010b4a323c28397005b7ccd02801dfa7b31"} Jul 27 09:55:09.528614 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.528577 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:55:09.532944 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.532526 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.535985 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.536252 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.536480 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.536773 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.536851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.536984 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.536996 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 09:55:09.537151 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.537112 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ulc056le92cr\"" Jul 27 09:55:09.537643 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.537282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 09:55:09.538485 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.538310 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 09:55:09.540091 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.540072 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v665p\"" Jul 27 09:55:09.540329 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.540307 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 09:55:09.540521 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.540506 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 09:55:09.542245 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.540693 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 09:55:09.542245 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.541368 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 09:55:09.542245 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.541729 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 09:55:09.550567 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.550539 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 09:55:09.553322 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.553302 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:55:09.669763 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669763 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669999 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669999 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77c4z\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-kube-api-access-77c4z\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669999 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669999 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669999 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.669999 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.669982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670279 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670279 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670279 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670279 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670279 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.670500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.670499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771295 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771465 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.771736 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772183 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77c4z\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-kube-api-access-77c4z\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772183 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772183 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772183 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772183 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.771925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772535 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.772506 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.772780 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.772566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.773195 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.772976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.773195 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.773008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.774227 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.773845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.775015 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.774904 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.775335 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.775293 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config-out\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.775466 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.775439 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.775722 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.775698 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.776321 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.776295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.777063 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.777036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.777252 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.777228 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.777378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.777352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-web-config\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.777836 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.777811 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.777927 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.777838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.778225 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.778199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.778312 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.778277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.779141 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.779084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.779242 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.779217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.784208 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.784188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77c4z\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-kube-api-access-77c4z\") pod \"prometheus-k8s-0\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:09.849648 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:09.849609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:10.007540 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:10.007516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:55:10.010175 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:55:10.010148 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b1fe23_ef1a_447a_bbd3_dc939d1f12f3.slice/crio-7153ebd115600e5920c8c77c2e6d588e1e2a230d4bb884fa35e67307eec59e00 WatchSource:0}: Error finding container 7153ebd115600e5920c8c77c2e6d588e1e2a230d4bb884fa35e67307eec59e00: Status 404 returned error can't find the container with id 7153ebd115600e5920c8c77c2e6d588e1e2a230d4bb884fa35e67307eec59e00 Jul 27 09:55:10.823103 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:10.823056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"7153ebd115600e5920c8c77c2e6d588e1e2a230d4bb884fa35e67307eec59e00"} Jul 27 09:55:11.828813 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:11.828778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dcd5c7c9-htrm5" event={"ID":"5eb6df92-c668-43dd-ae9e-38c07bb1eb38","Type":"ContainerStarted","Data":"5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268"} Jul 27 09:55:11.851241 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:11.851198 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56dcd5c7c9-htrm5" podStartSLOduration=1.162503955 podStartE2EDuration="3.851178462s" totalImagesPullingTime="2.688674507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:11.850585501 +0000 UTC m=+285.510571331" watchObservedRunningTime="2026-07-27 09:55:11.851178462 +0000 UTC m=+285.511164293" Jul 27 09:55:12.192392 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.192366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:55:12.194681 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.194661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63b086bd-8aa3-4928-bcca-82e1fce413ec-metrics-tls\") pod \"dns-default-rhjr2\" (UID: \"63b086bd-8aa3-4928-bcca-82e1fce413ec\") " pod="openshift-dns/dns-default-rhjr2" Jul 27 09:55:12.417806 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.417773 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r9nsb\"" Jul 27 09:55:12.425424 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.425405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rhjr2" Jul 27 09:55:12.554409 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.554375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rhjr2"] Jul 27 09:55:12.557514 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:55:12.557489 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b086bd_8aa3_4928_bcca_82e1fce413ec.slice/crio-5e77e974a4ed73c820032e414f25a8dee5e0ffa33b444366a9fb0269a58f91fd WatchSource:0}: Error finding container 5e77e974a4ed73c820032e414f25a8dee5e0ffa33b444366a9fb0269a58f91fd: Status 404 returned error can't find the container with id 5e77e974a4ed73c820032e414f25a8dee5e0ffa33b444366a9fb0269a58f91fd Jul 27 09:55:12.838652 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.838551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rhjr2" event={"ID":"63b086bd-8aa3-4928-bcca-82e1fce413ec","Type":"ContainerStarted","Data":"5e77e974a4ed73c820032e414f25a8dee5e0ffa33b444366a9fb0269a58f91fd"} Jul 27 09:55:12.840181 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.840152 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" exitCode=0 Jul 27 09:55:12.840284 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:12.840239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} Jul 27 09:55:14.852484 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:14.852403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rhjr2" event={"ID":"63b086bd-8aa3-4928-bcca-82e1fce413ec","Type":"ContainerStarted","Data":"9aa94badf1f0b1645efc881a26e2ee576232e0e9cb2db79806d81ac1c6137143"} Jul 27 09:55:14.852484 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:14.852462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rhjr2" event={"ID":"63b086bd-8aa3-4928-bcca-82e1fce413ec","Type":"ContainerStarted","Data":"adab050c3f90e6405d0c4ee17079436a335542fdce58cfb3a9430eb954cab2ef"} Jul 27 09:55:14.852958 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:14.852544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rhjr2" Jul 27 09:55:14.873630 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:14.873590 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rhjr2" podStartSLOduration=250.9055052 podStartE2EDuration="4m12.873575981s" totalImagesPullingTime="1.968070781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:14.872424723 +0000 UTC m=+288.532410550" watchObservedRunningTime="2026-07-27 09:55:14.873575981 +0000 UTC m=+288.533561807" Jul 27 09:55:15.358672 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:15.358645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:55:15.733070 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:15.733033 2581 patch_prober.go:28] interesting pod/image-registry-7c54f65d49-9r94f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 09:55:15.733239 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:15.733093 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" podUID="179a9bd8-0a2c-4c1e-859a-7b3f9f045dce" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 09:55:16.862262 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:16.862225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} Jul 27 09:55:16.862640 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:16.862300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} Jul 27 09:55:17.869127 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:17.869071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} Jul 27 09:55:17.869412 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:17.869129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} Jul 27 09:55:17.869412 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:17.869155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} Jul 27 09:55:17.869412 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:17.869179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerStarted","Data":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} Jul 27 09:55:18.467907 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:18.467869 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:18.468075 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:18.467938 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:18.472658 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:18.472632 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:18.495573 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:18.495528 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.01261626 podStartE2EDuration="9.495511627s" totalImagesPullingTime="6.46130527s" totalInitContainerRuntime="21.590097ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:55:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:55:17.915510905 +0000 UTC m=+291.575496732" watchObservedRunningTime="2026-07-27 09:55:18.495511627 +0000 UTC m=+292.155497509" Jul 27 09:55:18.776926 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:18.776854 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c54f65d49-9r94f" Jul 27 09:55:18.879007 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:18.878982 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:55:19.850473 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:19.850439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:55:20.376822 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.376782 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" podUID="4202ae2d-8718-4291-9e37-8c92ce9480ce" containerName="registry" containerID="cri-o://351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea" gracePeriod=30 Jul 27 09:55:20.690888 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.690868 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:55:20.771314 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771287 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-bound-sa-token\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771449 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771319 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6lb9\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-kube-api-access-b6lb9\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771449 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771351 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-image-registry-private-configuration\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771449 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771373 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-trusted-ca\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771449 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771418 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4202ae2d-8718-4291-9e37-8c92ce9480ce-ca-trust-extracted\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771449 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771437 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771492 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-certificates\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771805 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771741 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-installation-pull-secrets\") pod \"4202ae2d-8718-4291-9e37-8c92ce9480ce\" (UID: \"4202ae2d-8718-4291-9e37-8c92ce9480ce\") " Jul 27 09:55:20.771921 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771898 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:20.771982 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.771923 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:55:20.772093 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.772051 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-trusted-ca\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.772093 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.772070 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-certificates\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.773807 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.773783 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-kube-api-access-b6lb9" (OuterVolumeSpecName: "kube-api-access-b6lb9") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "kube-api-access-b6lb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:20.773903 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.773846 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:20.773979 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.773956 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:20.774518 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.774491 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:55:20.774600 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.774510 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:55:20.780030 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.780010 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4202ae2d-8718-4291-9e37-8c92ce9480ce-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4202ae2d-8718-4291-9e37-8c92ce9480ce" (UID: "4202ae2d-8718-4291-9e37-8c92ce9480ce"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:55:20.873009 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.872985 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4202ae2d-8718-4291-9e37-8c92ce9480ce-ca-trust-extracted\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.873009 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.873006 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-registry-tls\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.873123 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.873015 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-installation-pull-secrets\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.873123 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.873023 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-bound-sa-token\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.873123 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.873032 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6lb9\" (UniqueName: \"kubernetes.io/projected/4202ae2d-8718-4291-9e37-8c92ce9480ce-kube-api-access-b6lb9\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.873123 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.873040 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4202ae2d-8718-4291-9e37-8c92ce9480ce-image-registry-private-configuration\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:55:20.880166 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.880145 2581 generic.go:356] "Generic (PLEG): container finished" podID="9878a111-31b9-4522-9505-df02bcd6451b" containerID="8d15797d1835bc0fc7d05fe9023271c9b626b1f3bf6a026a25d6bbcbf03d31ea" exitCode=255 Jul 27 09:55:20.880255 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.880208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" event={"ID":"9878a111-31b9-4522-9505-df02bcd6451b","Type":"ContainerDied","Data":"8d15797d1835bc0fc7d05fe9023271c9b626b1f3bf6a026a25d6bbcbf03d31ea"} Jul 27 09:55:20.880255 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.880242 2581 scope.go:117] "RemoveContainer" containerID="e7fbea2538c9a038490c116ed33014f6097def69ba8fdd8e31f592e8d138ef30" Jul 27 09:55:20.881514 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.881486 2581 generic.go:356] "Generic (PLEG): container finished" podID="4202ae2d-8718-4291-9e37-8c92ce9480ce" containerID="351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea" exitCode=0 Jul 27 09:55:20.881589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.881529 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" Jul 27 09:55:20.881589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.881570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" event={"ID":"4202ae2d-8718-4291-9e37-8c92ce9480ce","Type":"ContainerDied","Data":"351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea"} Jul 27 09:55:20.881706 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.881610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c875c489c-zjmxv" event={"ID":"4202ae2d-8718-4291-9e37-8c92ce9480ce","Type":"ContainerDied","Data":"5d19281b864ea84c3d2b8d89b4cd1cefd35ed7d8f620682c2b4e8db0d02264bc"} Jul 27 09:55:20.887329 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.887313 2581 scope.go:117] "RemoveContainer" containerID="8d15797d1835bc0fc7d05fe9023271c9b626b1f3bf6a026a25d6bbcbf03d31ea" Jul 27 09:55:20.887490 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:20.887473 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7_open-cluster-management-agent-addon(9878a111-31b9-4522-9505-df02bcd6451b)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" podUID="9878a111-31b9-4522-9505-df02bcd6451b" Jul 27 09:55:20.892685 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.892668 2581 scope.go:117] "RemoveContainer" containerID="351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea" Jul 27 09:55:20.899602 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.899585 2581 scope.go:117] "RemoveContainer" containerID="351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea" Jul 27 09:55:20.899857 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:20.899837 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea\": container with ID starting with 351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea not found: ID does not exist" containerID="351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea" Jul 27 09:55:20.899911 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.899863 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea"} err="failed to get container status \"351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea\": rpc error: code = NotFound desc = could not find container \"351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea\": container with ID starting with 351a1a0243114910dd785ee6415d77acb7bf7abe69899683ece285336e1b9bea not found: ID does not exist" Jul 27 09:55:20.916171 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.916152 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c875c489c-zjmxv"] Jul 27 09:55:20.923289 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:20.923269 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c875c489c-zjmxv"] Jul 27 09:55:22.815909 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:22.815879 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4202ae2d-8718-4291-9e37-8c92ce9480ce" path="/var/lib/kubelet/pods/4202ae2d-8718-4291-9e37-8c92ce9480ce/volumes" Jul 27 09:55:23.811179 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:23.811138 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zvq9q" podUID="b6db3599-f13b-41f9-9bcb-692774d28e10" Jul 27 09:55:24.857900 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:24.857865 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rhjr2" Jul 27 09:55:26.348005 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:26.347972 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" Jul 27 09:55:26.348354 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:26.348307 2581 scope.go:117] "RemoveContainer" containerID="8d15797d1835bc0fc7d05fe9023271c9b626b1f3bf6a026a25d6bbcbf03d31ea" Jul 27 09:55:26.348490 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:55:26.348472 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7_open-cluster-management-agent-addon(9878a111-31b9-4522-9505-df02bcd6451b)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" podUID="9878a111-31b9-4522-9505-df02bcd6451b" Jul 27 09:55:26.703725 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:26.703697 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 09:55:34.816215 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:34.816185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:55:36.818563 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:36.818540 2581 scope.go:117] "RemoveContainer" containerID="8d15797d1835bc0fc7d05fe9023271c9b626b1f3bf6a026a25d6bbcbf03d31ea" Jul 27 09:55:36.946190 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:36.946155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f468dd4dd-5jsl7" event={"ID":"9878a111-31b9-4522-9505-df02bcd6451b","Type":"ContainerStarted","Data":"47a5342b4df5a4edb4f5350837265dfa790e2ec0f982dc9861b28f04ca8bf74c"} Jul 27 09:55:41.964713 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:41.964680 2581 generic.go:356] "Generic (PLEG): container finished" podID="411208fb-3108-4137-add3-ed8820fe90b7" containerID="d8dcf19f7892735a23943abf2ef0c7b6dddb91b624fd9280d7cc5c1526404204" exitCode=0 Jul 27 09:55:41.965122 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:41.964774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" event={"ID":"411208fb-3108-4137-add3-ed8820fe90b7","Type":"ContainerDied","Data":"d8dcf19f7892735a23943abf2ef0c7b6dddb91b624fd9280d7cc5c1526404204"} Jul 27 09:55:41.965122 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:41.965086 2581 scope.go:117] "RemoveContainer" containerID="d8dcf19f7892735a23943abf2ef0c7b6dddb91b624fd9280d7cc5c1526404204" Jul 27 09:55:42.969317 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:42.969286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf" event={"ID":"411208fb-3108-4137-add3-ed8820fe90b7","Type":"ContainerStarted","Data":"fc0f0baaefcf67a19407ff128df78e247cbc9b96acb40a734d65ffbca739e77b"} Jul 27 09:55:52.001352 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:52.001315 2581 generic.go:356] "Generic (PLEG): container finished" podID="7be59250-e839-442a-93c7-1ca86793dc51" containerID="59f3799882d9c957a688aa6ca248e4166c9c62e6db0c1dece60d7f20553075d9" exitCode=0 Jul 27 09:55:52.001721 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:52.001368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" event={"ID":"7be59250-e839-442a-93c7-1ca86793dc51","Type":"ContainerDied","Data":"59f3799882d9c957a688aa6ca248e4166c9c62e6db0c1dece60d7f20553075d9"} Jul 27 09:55:52.001721 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:52.001695 2581 scope.go:117] "RemoveContainer" containerID="59f3799882d9c957a688aa6ca248e4166c9c62e6db0c1dece60d7f20553075d9" Jul 27 09:55:53.006918 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:55:53.006880 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-qg724" event={"ID":"7be59250-e839-442a-93c7-1ca86793dc51","Type":"ContainerStarted","Data":"fc6410ad6a1f2b81ba7b367fcd8e6297df7c17640e9aaccc46ffa98bf860cb2d"} Jul 27 09:56:09.850805 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:09.850765 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:09.866945 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:09.866923 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:10.087879 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:10.087853 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:28.180802 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.180706 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:56:28.181260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.181062 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="prometheus" containerID="cri-o://e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" gracePeriod=600 Jul 27 09:56:28.181260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.181088 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="thanos-sidecar" containerID="cri-o://7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" gracePeriod=600 Jul 27 09:56:28.181260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.181110 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-web" containerID="cri-o://f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" gracePeriod=600 Jul 27 09:56:28.181260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.181145 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" gracePeriod=600 Jul 27 09:56:28.181260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.181139 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="config-reloader" containerID="cri-o://9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" gracePeriod=600 Jul 27 09:56:28.181260 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.181084 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy" containerID="cri-o://59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" gracePeriod=600 Jul 27 09:56:28.425170 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.425139 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:28.520935 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.520904 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-thanos-prometheus-http-client-file\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.520935 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.520935 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-tls\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.520968 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-db\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.520991 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521103 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-metrics-client-ca\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521321 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521191 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-kube-rbac-proxy\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521321 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521222 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-web-config\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521321 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521248 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-serving-certs-ca-bundle\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521321 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521286 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-metrics-client-certs\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521321 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521314 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-1\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521348 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521387 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-2\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521413 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-trusted-ca-bundle\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521437 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521468 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-tls-assets\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521469 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521505 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config-out\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521562 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521534 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-grpc-tls\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521965 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77c4z\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-kube-api-access-77c4z\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521965 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521777 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-0\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.521965 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.521823 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-kubelet-serving-ca-bundle\") pod \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\" (UID: \"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3\") " Jul 27 09:56:28.522113 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.522092 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-metrics-client-ca\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.522375 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.522251 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:56:28.522861 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.522827 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.522957 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.522865 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.523069 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.523019 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.523331 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.523306 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.524997 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.524961 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.525158 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525139 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:56:28.525459 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525432 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525731 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525767 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-kube-api-access-77c4z" (OuterVolumeSpecName: "kube-api-access-77c4z") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "kube-api-access-77c4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525789 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525806 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525841 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525856 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.525865 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.525866 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config" (OuterVolumeSpecName: "config") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.526145 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.526126 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.527157 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.527128 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.527530 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.527510 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config-out" (OuterVolumeSpecName: "config-out") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:56:28.536018 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.535954 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-web-config" (OuterVolumeSpecName: "web-config") pod "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" (UID: "58b1fe23-ef1a-447a-bbd3-dc939d1f12f3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:56:28.623391 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623345 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623391 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623386 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623391 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623398 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-db\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623391 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623407 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623416 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-kube-rbac-proxy\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623426 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-web-config\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623434 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623442 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-metrics-client-certs\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623450 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623458 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623467 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623475 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623483 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623491 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-tls-assets\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623499 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-config-out\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623506 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-secret-grpc-tls\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623514 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77c4z\" (UniqueName: \"kubernetes.io/projected/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-kube-api-access-77c4z\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623521 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:28.623660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:28.623529 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:56:29.141718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141633 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" exitCode=0 Jul 27 09:56:29.141718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141657 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" exitCode=0 Jul 27 09:56:29.141718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141663 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" exitCode=0 Jul 27 09:56:29.141718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141670 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" exitCode=0 Jul 27 09:56:29.141718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141675 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" exitCode=0 Jul 27 09:56:29.141718 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141681 2581 generic.go:356] "Generic (PLEG): container finished" podID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" exitCode=0 Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141719 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141887 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.141991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} Jul 27 09:56:29.142039 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.142034 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58b1fe23-ef1a-447a-bbd3-dc939d1f12f3","Type":"ContainerDied","Data":"7153ebd115600e5920c8c77c2e6d588e1e2a230d4bb884fa35e67307eec59e00"} Jul 27 09:56:29.149379 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.149362 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.156085 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.156069 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.162534 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.162520 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.168684 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.168671 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.173797 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.173777 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:56:29.176246 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.176211 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.182411 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.182387 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:56:29.184187 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.184053 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.190415 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.190386 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.190658 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.190641 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.190731 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.190670 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} err="failed to get container status \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" Jul 27 09:56:29.190731 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.190694 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.190988 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.190968 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.191036 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.190994 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} err="failed to get container status \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" Jul 27 09:56:29.191036 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191011 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.191217 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.191203 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.191259 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191221 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} err="failed to get container status \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" Jul 27 09:56:29.191259 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191240 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.191457 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.191439 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.191524 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191464 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} err="failed to get container status \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" Jul 27 09:56:29.191524 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191484 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.191696 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.191672 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.191840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191700 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} err="failed to get container status \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" Jul 27 09:56:29.191840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191713 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.191991 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.191974 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.192047 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.191994 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} err="failed to get container status \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" Jul 27 09:56:29.192047 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192007 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.192240 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:56:29.192225 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.192286 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192243 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} err="failed to get container status \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" Jul 27 09:56:29.192286 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192256 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.192529 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192514 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} err="failed to get container status \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" Jul 27 09:56:29.192529 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192528 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.192790 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192772 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} err="failed to get container status \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" Jul 27 09:56:29.192870 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.192794 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.193302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193020 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} err="failed to get container status \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" Jul 27 09:56:29.193302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193036 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.193302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193233 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} err="failed to get container status \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" Jul 27 09:56:29.193302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193246 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.193510 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193421 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} err="failed to get container status \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" Jul 27 09:56:29.193510 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193434 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.193701 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193639 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} err="failed to get container status \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" Jul 27 09:56:29.193701 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193651 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.193947 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193844 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} err="failed to get container status \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" Jul 27 09:56:29.193947 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.193859 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.194120 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194042 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} err="failed to get container status \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" Jul 27 09:56:29.194120 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194054 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.194308 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194234 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} err="failed to get container status \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" Jul 27 09:56:29.194308 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194252 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.194525 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194446 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} err="failed to get container status \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" Jul 27 09:56:29.194525 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194468 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.194836 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194668 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} err="failed to get container status \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" Jul 27 09:56:29.194836 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.194708 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.195140 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195046 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} err="failed to get container status \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" Jul 27 09:56:29.195140 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195070 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.195339 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195313 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} err="failed to get container status \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" Jul 27 09:56:29.195415 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195338 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.195656 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195633 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} err="failed to get container status \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" Jul 27 09:56:29.195656 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195655 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.196016 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.195992 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} err="failed to get container status \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" Jul 27 09:56:29.196099 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196019 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.196376 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196343 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} err="failed to get container status \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" Jul 27 09:56:29.196459 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196377 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.196672 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196647 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} err="failed to get container status \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" Jul 27 09:56:29.196787 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196674 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.196985 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196960 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} err="failed to get container status \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" Jul 27 09:56:29.197090 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.196986 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.197288 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.197269 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} err="failed to get container status \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" Jul 27 09:56:29.197365 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.197297 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.197566 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.197541 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} err="failed to get container status \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" Jul 27 09:56:29.197660 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.197568 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.197864 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.197841 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} err="failed to get container status \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" Jul 27 09:56:29.197922 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.197866 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.198134 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198102 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} err="failed to get container status \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" Jul 27 09:56:29.198134 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198132 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.198417 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198394 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} err="failed to get container status \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" Jul 27 09:56:29.198417 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198420 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.198709 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198679 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} err="failed to get container status \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" Jul 27 09:56:29.198709 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198709 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.198976 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198951 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} err="failed to get container status \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" Jul 27 09:56:29.199041 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.198978 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.199254 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.199231 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} err="failed to get container status \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" Jul 27 09:56:29.199334 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.199257 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.199500 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.199482 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} err="failed to get container status \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" Jul 27 09:56:29.199571 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.199501 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.199776 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.199731 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} err="failed to get container status \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" Jul 27 09:56:29.199850 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.199779 2581 scope.go:117] "RemoveContainer" containerID="dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486" Jul 27 09:56:29.200059 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200028 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486"} err="failed to get container status \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": rpc error: code = NotFound desc = could not find container \"dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486\": container with ID starting with dbffee096a1edab3dd02c63761ae59fc0a22ccfc99dae34ac9491379cf2c3486 not found: ID does not exist" Jul 27 09:56:29.200118 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200060 2581 scope.go:117] "RemoveContainer" containerID="59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6" Jul 27 09:56:29.200295 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200277 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6"} err="failed to get container status \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": rpc error: code = NotFound desc = could not find container \"59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6\": container with ID starting with 59bb4b9b6f64bad87d02f12189aa89d0e252783647ea2a0ef0db3001e10502a6 not found: ID does not exist" Jul 27 09:56:29.200355 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200297 2581 scope.go:117] "RemoveContainer" containerID="f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53" Jul 27 09:56:29.200552 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200534 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53"} err="failed to get container status \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": rpc error: code = NotFound desc = could not find container \"f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53\": container with ID starting with f2f546e0874b4ba4f240f8e349945369c4fcb108d1478a37a2ddcdc717cbcd53 not found: ID does not exist" Jul 27 09:56:29.200614 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200553 2581 scope.go:117] "RemoveContainer" containerID="7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5" Jul 27 09:56:29.200803 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200782 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5"} err="failed to get container status \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": rpc error: code = NotFound desc = could not find container \"7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5\": container with ID starting with 7de2ec25504df7e6872c1c5f94d001320390e8ed444e7741c8e9c0d908952ed5 not found: ID does not exist" Jul 27 09:56:29.200803 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200803 2581 scope.go:117] "RemoveContainer" containerID="9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb" Jul 27 09:56:29.201015 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.200994 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb"} err="failed to get container status \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": rpc error: code = NotFound desc = could not find container \"9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb\": container with ID starting with 9653dc995a27db2db8ea89248bec7485b14e8ffda78a001032e95e66c0d890bb not found: ID does not exist" Jul 27 09:56:29.201075 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.201016 2581 scope.go:117] "RemoveContainer" containerID="e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade" Jul 27 09:56:29.201295 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.201233 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade"} err="failed to get container status \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": rpc error: code = NotFound desc = could not find container \"e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade\": container with ID starting with e219468e2e4f5b11f8cd73ad872b5fd21f5e7caf85f0145525b9a05f2f3c2ade not found: ID does not exist" Jul 27 09:56:29.201371 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.201297 2581 scope.go:117] "RemoveContainer" containerID="66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae" Jul 27 09:56:29.201546 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.201526 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae"} err="failed to get container status \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": rpc error: code = NotFound desc = could not find container \"66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae\": container with ID starting with 66a03fdee34aa8ea02d73221858dd86d991a4ee4dcdce0f943e4f66b6841fdae not found: ID does not exist" Jul 27 09:56:29.218890 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.218870 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:56:29.219119 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219108 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-thanos" Jul 27 09:56:29.219162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219125 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-thanos" Jul 27 09:56:29.219162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219136 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy" Jul 27 09:56:29.219162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219141 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy" Jul 27 09:56:29.219162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219153 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="config-reloader" Jul 27 09:56:29.219162 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219158 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="config-reloader" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219166 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-web" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219172 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-web" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219181 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="init-config-reloader" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219186 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="init-config-reloader" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219193 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4202ae2d-8718-4291-9e37-8c92ce9480ce" containerName="registry" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219202 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4202ae2d-8718-4291-9e37-8c92ce9480ce" containerName="registry" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219213 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="prometheus" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219219 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="prometheus" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219228 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="thanos-sidecar" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219233 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="thanos-sidecar" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219272 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="prometheus" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219280 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4202ae2d-8718-4291-9e37-8c92ce9480ce" containerName="registry" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219288 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="thanos-sidecar" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219295 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219301 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="config-reloader" Jul 27 09:56:29.219302 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219306 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-web" Jul 27 09:56:29.219766 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.219312 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" containerName="kube-rbac-proxy-thanos" Jul 27 09:56:29.223184 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.223171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.230730 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.230705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 09:56:29.230840 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.230714 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 09:56:29.230908 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.230843 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 09:56:29.231149 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.231132 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v665p\"" Jul 27 09:56:29.231207 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.231168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 09:56:29.231967 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.231954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 09:56:29.232277 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.232262 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 09:56:29.232330 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.232277 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 09:56:29.232330 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.232267 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 09:56:29.232831 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.232816 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 09:56:29.232905 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.232829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 09:56:29.233041 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.233027 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 09:56:29.233088 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.233074 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 09:56:29.233339 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.233327 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 09:56:29.233375 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.233327 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ulc056le92cr\"" Jul 27 09:56:29.237105 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.237088 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 09:56:29.248667 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.248652 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 09:56:29.259631 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.259610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:56:29.329046 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329173 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329173 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329173 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329173 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-config\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329173 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329378 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtbl\" (UniqueName: \"kubernetes.io/projected/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-kube-api-access-9xtbl\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.329589 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.329581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430621 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430621 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430621 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtbl\" (UniqueName: \"kubernetes.io/projected/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-kube-api-access-9xtbl\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.430827 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.430995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-config\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431160 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431765 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431848 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.431904 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.431705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.432900 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.432542 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.434698 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.433576 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.434698 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.433892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.434698 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.434167 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.434698 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.434606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.434698 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.434654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.435017 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.434937 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.435017 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.435004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-config\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.435494 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.435470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.436120 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.435597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.436120 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.436082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.436319 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.436293 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.436397 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.436373 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.437009 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.436989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.437230 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.437214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.437383 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.437362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.444207 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.444186 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtbl\" (UniqueName: \"kubernetes.io/projected/b2b1a7ac-daee-436f-b1a0-224d6fb11f09-kube-api-access-9xtbl\") pod \"prometheus-k8s-0\" (UID: \"b2b1a7ac-daee-436f-b1a0-224d6fb11f09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.531979 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.531948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:29.687043 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:29.687007 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:56:29.689146 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:56:29.689117 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b1a7ac_daee_436f_b1a0_224d6fb11f09.slice/crio-f81461ddfc18c06c03a38899dc7cae6306cf65755158e4b7b14e4c381b9aa2c9 WatchSource:0}: Error finding container f81461ddfc18c06c03a38899dc7cae6306cf65755158e4b7b14e4c381b9aa2c9: Status 404 returned error can't find the container with id f81461ddfc18c06c03a38899dc7cae6306cf65755158e4b7b14e4c381b9aa2c9 Jul 27 09:56:30.147517 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:30.147481 2581 generic.go:356] "Generic (PLEG): container finished" podID="b2b1a7ac-daee-436f-b1a0-224d6fb11f09" containerID="d03d70aff5b32fef6c5b56c7fd85d4d25144978611aa69587ef876333f78427b" exitCode=0 Jul 27 09:56:30.147848 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:30.147566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerDied","Data":"d03d70aff5b32fef6c5b56c7fd85d4d25144978611aa69587ef876333f78427b"} Jul 27 09:56:30.147848 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:30.147628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"f81461ddfc18c06c03a38899dc7cae6306cf65755158e4b7b14e4c381b9aa2c9"} Jul 27 09:56:30.815695 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:30.815663 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b1fe23-ef1a-447a-bbd3-dc939d1f12f3" path="/var/lib/kubelet/pods/58b1fe23-ef1a-447a-bbd3-dc939d1f12f3/volumes" Jul 27 09:56:31.154456 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.154374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"17904e9e6e84f3a60056d209763842d006e6e2bc5e9386caf841bd12f9364fa7"} Jul 27 09:56:31.154456 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.154435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"98c32c6e83e473f08025631dbc03d73f0e6952788daeeb7dcd9305093c6f269e"} Jul 27 09:56:31.154611 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.154462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"2285a103b679e32dee7b3e84ad238e6a4b22013ce16f8bdd077eef38b5402d56"} Jul 27 09:56:31.154611 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.154487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"f867512cd4c84aaef2ca196ef7d7ee57aa3a3dfd89d2db3306d6b3dccdbc4d0b"} Jul 27 09:56:31.154611 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.154511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"1da649b258a1a7fac12434752db91dd4f26ab5d560aaac03e2751e3271d25dd8"} Jul 27 09:56:31.154611 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.154534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2b1a7ac-daee-436f-b1a0-224d6fb11f09","Type":"ContainerStarted","Data":"b4711a790f3b7626cdd527d24dd0385031836962c1f5221c65c9eb0aa904f55c"} Jul 27 09:56:31.188956 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:31.188913 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.168777648 podStartE2EDuration="2.188897535s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.119887ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:56:31.187811693 +0000 UTC m=+364.847797520" watchObservedRunningTime="2026-07-27 09:56:31.188897535 +0000 UTC m=+364.848883355" Jul 27 09:56:34.532642 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:34.532588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:56:39.626454 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:39.626412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:56:39.628797 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:39.628778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6db3599-f13b-41f9-9bcb-692774d28e10-metrics-certs\") pod \"network-metrics-daemon-zvq9q\" (UID: \"b6db3599-f13b-41f9-9bcb-692774d28e10\") " pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:56:39.919611 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:39.919540 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ngfpk\"" Jul 27 09:56:39.927854 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:39.927837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zvq9q" Jul 27 09:56:40.055889 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:40.055858 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zvq9q"] Jul 27 09:56:40.058921 ip-10-0-134-146 kubenswrapper[2581]: W0727 09:56:40.058897 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6db3599_f13b_41f9_9bcb_692774d28e10.slice/crio-90cf35270108806cc6243b09f3972ae471d1590b61e966aeffbde146e2542442 WatchSource:0}: Error finding container 90cf35270108806cc6243b09f3972ae471d1590b61e966aeffbde146e2542442: Status 404 returned error can't find the container with id 90cf35270108806cc6243b09f3972ae471d1590b61e966aeffbde146e2542442 Jul 27 09:56:40.060880 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:40.060863 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 09:56:40.190205 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:40.190176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvq9q" event={"ID":"b6db3599-f13b-41f9-9bcb-692774d28e10","Type":"ContainerStarted","Data":"90cf35270108806cc6243b09f3972ae471d1590b61e966aeffbde146e2542442"} Jul 27 09:56:41.195460 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:41.195430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvq9q" event={"ID":"b6db3599-f13b-41f9-9bcb-692774d28e10","Type":"ContainerStarted","Data":"f50a3c75a2cd49aa97a836489d5e072357d66d65270ed71f10c9b0925b0319da"} Jul 27 09:56:41.195871 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:41.195483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zvq9q" event={"ID":"b6db3599-f13b-41f9-9bcb-692774d28e10","Type":"ContainerStarted","Data":"b611e885bada9357094a33e40faa2c95c26254e17f2abf4ca00ee08d870473cf"} Jul 27 09:56:41.214154 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:41.214107 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zvq9q" podStartSLOduration=374.341479294 podStartE2EDuration="6m15.214089549s" totalImagesPullingTime="872.610255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:56:41.212939395 +0000 UTC m=+374.872925223" watchObservedRunningTime="2026-07-27 09:56:41.214089549 +0000 UTC m=+374.874075378" Jul 27 09:56:43.293590 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:56:43.291142 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dcd5c7c9-htrm5"] Jul 27 09:57:08.312858 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.312820 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56dcd5c7c9-htrm5" podUID="5eb6df92-c668-43dd-ae9e-38c07bb1eb38" containerName="console" containerID="cri-o://5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268" gracePeriod=15 Jul 27 09:57:08.552984 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.552963 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:57:08.637764 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637673 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-service-ca\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.637912 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637773 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcblc\" (UniqueName: \"kubernetes.io/projected/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-kube-api-access-xcblc\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.637912 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637825 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-oauth-config\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.637912 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637847 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-config\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.637912 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637882 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-serving-cert\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.637912 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637913 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-oauth-serving-cert\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.638164 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.637941 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-trusted-ca-bundle\") pod \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\" (UID: \"5eb6df92-c668-43dd-ae9e-38c07bb1eb38\") " Jul 27 09:57:08.638164 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.638053 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-service-ca" (OuterVolumeSpecName: "service-ca") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:57:08.638281 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.638262 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-config" (OuterVolumeSpecName: "console-config") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:57:08.638281 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.638267 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:57:08.638374 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.638277 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-service-ca\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:08.638374 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.638366 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:57:08.640180 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.640151 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:57:08.640282 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.640187 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:57:08.640282 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.640197 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-kube-api-access-xcblc" (OuterVolumeSpecName: "kube-api-access-xcblc") pod "5eb6df92-c668-43dd-ae9e-38c07bb1eb38" (UID: "5eb6df92-c668-43dd-ae9e-38c07bb1eb38"). InnerVolumeSpecName "kube-api-access-xcblc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:57:08.738858 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.738831 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-serving-cert\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:08.738858 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.738853 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-oauth-serving-cert\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:08.738858 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.738862 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-trusted-ca-bundle\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:08.739056 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.738870 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcblc\" (UniqueName: \"kubernetes.io/projected/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-kube-api-access-xcblc\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:08.739056 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.738878 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-oauth-config\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:08.739056 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:08.738886 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6df92-c668-43dd-ae9e-38c07bb1eb38-console-config\") on node \"ip-10-0-134-146.ec2.internal\" DevicePath \"\"" Jul 27 09:57:09.296797 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.296767 2581 generic.go:356] "Generic (PLEG): container finished" podID="5eb6df92-c668-43dd-ae9e-38c07bb1eb38" containerID="5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268" exitCode=0 Jul 27 09:57:09.296946 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.296807 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dcd5c7c9-htrm5" Jul 27 09:57:09.296946 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.296846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dcd5c7c9-htrm5" event={"ID":"5eb6df92-c668-43dd-ae9e-38c07bb1eb38","Type":"ContainerDied","Data":"5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268"} Jul 27 09:57:09.296946 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.296896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dcd5c7c9-htrm5" event={"ID":"5eb6df92-c668-43dd-ae9e-38c07bb1eb38","Type":"ContainerDied","Data":"134086ade253080bd866135f65b84010b4a323c28397005b7ccd02801dfa7b31"} Jul 27 09:57:09.296946 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.296920 2581 scope.go:117] "RemoveContainer" containerID="5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268" Jul 27 09:57:09.304768 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.304738 2581 scope.go:117] "RemoveContainer" containerID="5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268" Jul 27 09:57:09.305023 ip-10-0-134-146 kubenswrapper[2581]: E0727 09:57:09.305006 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268\": container with ID starting with 5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268 not found: ID does not exist" containerID="5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268" Jul 27 09:57:09.305085 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.305031 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268"} err="failed to get container status \"5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268\": rpc error: code = NotFound desc = could not find container \"5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268\": container with ID starting with 5c5dd16ba06000fe7dd2724bb28d4c233887ef7d427cd4fea3a8696b38f2f268 not found: ID does not exist" Jul 27 09:57:09.315483 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.315462 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dcd5c7c9-htrm5"] Jul 27 09:57:09.320499 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:09.320480 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56dcd5c7c9-htrm5"] Jul 27 09:57:10.815519 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:10.815481 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb6df92-c668-43dd-ae9e-38c07bb1eb38" path="/var/lib/kubelet/pods/5eb6df92-c668-43dd-ae9e-38c07bb1eb38/volumes" Jul 27 09:57:29.532134 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:29.532093 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:57:29.547969 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:29.547946 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:57:30.388176 ip-10-0-134-146 kubenswrapper[2581]: I0727 09:57:30.388108 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 10:01:34.303265 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.303231 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9dzxm/must-gather-wkwq5"] Jul 27 10:01:34.303716 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.303472 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb6df92-c668-43dd-ae9e-38c07bb1eb38" containerName="console" Jul 27 10:01:34.303716 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.303482 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb6df92-c668-43dd-ae9e-38c07bb1eb38" containerName="console" Jul 27 10:01:34.303716 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.303552 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb6df92-c668-43dd-ae9e-38c07bb1eb38" containerName="console" Jul 27 10:01:34.306351 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.306336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.309164 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.309141 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dzxm\"/\"openshift-service-ca.crt\"" Jul 27 10:01:34.310230 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.310215 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9dzxm\"/\"default-dockercfg-fmzmv\"" Jul 27 10:01:34.310298 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.310220 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dzxm\"/\"kube-root-ca.crt\"" Jul 27 10:01:34.316657 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.316637 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dzxm/must-gather-wkwq5"] Jul 27 10:01:34.413702 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.413678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn66p\" (UniqueName: \"kubernetes.io/projected/2472243a-768e-4927-b791-1954b16a109a-kube-api-access-gn66p\") pod \"must-gather-wkwq5\" (UID: \"2472243a-768e-4927-b791-1954b16a109a\") " pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.413857 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.413714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2472243a-768e-4927-b791-1954b16a109a-must-gather-output\") pod \"must-gather-wkwq5\" (UID: \"2472243a-768e-4927-b791-1954b16a109a\") " pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.514363 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.514337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn66p\" (UniqueName: \"kubernetes.io/projected/2472243a-768e-4927-b791-1954b16a109a-kube-api-access-gn66p\") pod \"must-gather-wkwq5\" (UID: \"2472243a-768e-4927-b791-1954b16a109a\") " pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.514483 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.514377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2472243a-768e-4927-b791-1954b16a109a-must-gather-output\") pod \"must-gather-wkwq5\" (UID: \"2472243a-768e-4927-b791-1954b16a109a\") " pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.514709 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.514690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2472243a-768e-4927-b791-1954b16a109a-must-gather-output\") pod \"must-gather-wkwq5\" (UID: \"2472243a-768e-4927-b791-1954b16a109a\") " pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.523171 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.523152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn66p\" (UniqueName: \"kubernetes.io/projected/2472243a-768e-4927-b791-1954b16a109a-kube-api-access-gn66p\") pod \"must-gather-wkwq5\" (UID: \"2472243a-768e-4927-b791-1954b16a109a\") " pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.615104 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.615048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dzxm/must-gather-wkwq5" Jul 27 10:01:34.738901 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:34.738874 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dzxm/must-gather-wkwq5"] Jul 27 10:01:34.741846 ip-10-0-134-146 kubenswrapper[2581]: W0727 10:01:34.741811 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2472243a_768e_4927_b791_1954b16a109a.slice/crio-1928d8e604fd30b95259a98608baa1276ed55586a5ee883feaf3b956818ef211 WatchSource:0}: Error finding container 1928d8e604fd30b95259a98608baa1276ed55586a5ee883feaf3b956818ef211: Status 404 returned error can't find the container with id 1928d8e604fd30b95259a98608baa1276ed55586a5ee883feaf3b956818ef211 Jul 27 10:01:35.205321 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:35.205284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/must-gather-wkwq5" event={"ID":"2472243a-768e-4927-b791-1954b16a109a","Type":"ContainerStarted","Data":"1928d8e604fd30b95259a98608baa1276ed55586a5ee883feaf3b956818ef211"} Jul 27 10:01:36.212237 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:36.212189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/must-gather-wkwq5" event={"ID":"2472243a-768e-4927-b791-1954b16a109a","Type":"ContainerStarted","Data":"59c57abda25fd30d78bff28ee81936b52c7ae049c24ac8cc56fc6b8798e38af1"} Jul 27 10:01:36.212237 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:36.212231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/must-gather-wkwq5" event={"ID":"2472243a-768e-4927-b791-1954b16a109a","Type":"ContainerStarted","Data":"526f5862f5793ee1073e267b67901f9b6ca15646c50fd927906f04a41d9a9c05"} Jul 27 10:01:36.230928 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:36.230866 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9dzxm/must-gather-wkwq5" podStartSLOduration=1.280618542 podStartE2EDuration="2.230846357s" totalImagesPullingTime="950.227815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 10:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 10:01:36.228798648 +0000 UTC m=+669.888784475" watchObservedRunningTime="2026-07-27 10:01:36.230846357 +0000 UTC m=+669.890832184" Jul 27 10:01:37.062669 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:37.062644 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-46qr2_5f030b68-47a0-4e5d-9776-3499c80fb0a6/global-pull-secret-syncer/0.log" Jul 27 10:01:37.261165 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:37.261130 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q7t68_b8fdc7bf-b311-4e60-a5a1-bd30d1a97367/konnectivity-agent/0.log" Jul 27 10:01:37.315936 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:37.315870 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-146.ec2.internal_1fd77e6fdc961fb201c2b3fe02df46d9/haproxy/0.log" Jul 27 10:01:41.509070 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:41.508987 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jq55_4e4505b5-df09-47cf-acf5-bdb21c197595/node-exporter/0.log" Jul 27 10:01:41.541563 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:41.541529 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jq55_4e4505b5-df09-47cf-acf5-bdb21c197595/kube-rbac-proxy/0.log" Jul 27 10:01:41.576251 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:41.576226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jq55_4e4505b5-df09-47cf-acf5-bdb21c197595/init-textfile/0.log" Jul 27 10:01:41.910634 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:41.910509 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/prometheus/0.log" Jul 27 10:01:41.942486 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:41.942454 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/config-reloader/0.log" Jul 27 10:01:41.983093 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:41.983065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/thanos-sidecar/0.log" Jul 27 10:01:42.025404 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:42.025377 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/kube-rbac-proxy-web/0.log" Jul 27 10:01:42.064855 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:42.064782 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/kube-rbac-proxy/0.log" Jul 27 10:01:42.108499 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:42.108462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/kube-rbac-proxy-thanos/0.log" Jul 27 10:01:42.153014 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:42.152985 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b2b1a7ac-daee-436f-b1a0-224d6fb11f09/init-config-reloader/0.log" Jul 27 10:01:44.424887 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.424854 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8"] Jul 27 10:01:44.430205 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.430176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.442813 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.442784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8"] Jul 27 10:01:44.503905 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.503866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-proc\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.504098 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.503931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-lib-modules\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.504098 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.503989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-podres\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.504098 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.504047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-sys\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.504098 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.504097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grs9z\" (UniqueName: \"kubernetes.io/projected/856621c0-d515-4036-b77e-aba63921e3ce-kube-api-access-grs9z\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.605474 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grs9z\" (UniqueName: \"kubernetes.io/projected/856621c0-d515-4036-b77e-aba63921e3ce-kube-api-access-grs9z\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.605666 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-proc\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.605666 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-lib-modules\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.605807 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-podres\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.605807 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-proc\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.605807 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-sys\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.606058 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-lib-modules\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.606058 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605891 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-sys\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.606058 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.605931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/856621c0-d515-4036-b77e-aba63921e3ce-podres\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.614986 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.614935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grs9z\" (UniqueName: \"kubernetes.io/projected/856621c0-d515-4036-b77e-aba63921e3ce-kube-api-access-grs9z\") pod \"perf-node-gather-daemonset-vqcb8\" (UID: \"856621c0-d515-4036-b77e-aba63921e3ce\") " pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.745429 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.745143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:44.893976 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:44.893945 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8"] Jul 27 10:01:44.897245 ip-10-0-134-146 kubenswrapper[2581]: W0727 10:01:44.897215 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod856621c0_d515_4036_b77e_aba63921e3ce.slice/crio-6d18586b66b5bb4db66abdde51ea1bdff004f81d6477cd9bad638237db39970e WatchSource:0}: Error finding container 6d18586b66b5bb4db66abdde51ea1bdff004f81d6477cd9bad638237db39970e: Status 404 returned error can't find the container with id 6d18586b66b5bb4db66abdde51ea1bdff004f81d6477cd9bad638237db39970e Jul 27 10:01:45.255649 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:45.255608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" event={"ID":"856621c0-d515-4036-b77e-aba63921e3ce","Type":"ContainerStarted","Data":"8802a7f4bb21308c7a9ff2aaafe401e7ab0fb92d25fbe4eaafba277260971c0b"} Jul 27 10:01:45.255857 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:45.255662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" event={"ID":"856621c0-d515-4036-b77e-aba63921e3ce","Type":"ContainerStarted","Data":"6d18586b66b5bb4db66abdde51ea1bdff004f81d6477cd9bad638237db39970e"} Jul 27 10:01:45.255857 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:45.255810 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:45.273409 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:45.273367 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" podStartSLOduration=1.273353818 podStartE2EDuration="1.273353818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 10:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 10:01:45.272430268 +0000 UTC m=+678.932416095" watchObservedRunningTime="2026-07-27 10:01:45.273353818 +0000 UTC m=+678.933339644" Jul 27 10:01:46.020261 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:46.020229 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rhjr2_63b086bd-8aa3-4928-bcca-82e1fce413ec/dns/0.log" Jul 27 10:01:46.044567 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:46.044544 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rhjr2_63b086bd-8aa3-4928-bcca-82e1fce413ec/kube-rbac-proxy/0.log" Jul 27 10:01:46.120895 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:46.120872 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cmfkm_7e15fcfa-9ebc-4ad1-ad1f-7b0e02fbbc29/dns-node-resolver/0.log" Jul 27 10:01:46.527064 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:46.527034 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c54f65d49-9r94f_179a9bd8-0a2c-4c1e-859a-7b3f9f045dce/registry/0.log" Jul 27 10:01:46.554375 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:46.554346 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5c5xt_0463c002-a8e0-4385-90d4-fb04d302c0be/node-ca/0.log" Jul 27 10:01:47.331247 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:47.331220 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4cff98b7-525zf_f17bd644-f209-44aa-a389-e22dcbb6b589/router/0.log" Jul 27 10:01:47.889625 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:47.889589 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c4mkz_5ece7cf3-e32d-48e0-8574-0f28133ca284/serve-healthcheck-canary/0.log" Jul 27 10:01:48.418053 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:48.418028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-972hc_b8cc685e-6987-4a84-8c81-6b423cd7f452/kube-rbac-proxy/0.log" Jul 27 10:01:48.446144 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:48.446120 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-972hc_b8cc685e-6987-4a84-8c81-6b423cd7f452/exporter/0.log" Jul 27 10:01:48.469420 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:48.469394 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-972hc_b8cc685e-6987-4a84-8c81-6b423cd7f452/extractor/0.log" Jul 27 10:01:51.270843 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:51.270819 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9dzxm/perf-node-gather-daemonset-vqcb8" Jul 27 10:01:54.423853 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:54.423825 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf_411208fb-3108-4137-add3-ed8820fe90b7/kube-storage-version-migrator-operator/1.log" Jul 27 10:01:54.424603 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:54.424583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-g8mvf_411208fb-3108-4137-add3-ed8820fe90b7/kube-storage-version-migrator-operator/0.log" Jul 27 10:01:55.523691 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.523654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/kube-multus-additional-cni-plugins/0.log" Jul 27 10:01:55.567453 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.567427 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/egress-router-binary-copy/0.log" Jul 27 10:01:55.605860 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.605834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/cni-plugins/0.log" Jul 27 10:01:55.655568 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.655537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/bond-cni-plugin/0.log" Jul 27 10:01:55.693757 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.693729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/routeoverride-cni/0.log" Jul 27 10:01:55.738460 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.738441 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/whereabouts-cni-bincopy/0.log" Jul 27 10:01:55.778501 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:55.778438 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s5j_1074877b-bab2-488a-abf4-d59c2f1cf771/whereabouts-cni/0.log" Jul 27 10:01:56.253682 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:56.253657 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9q22_40140e9a-88c0-4ae7-bdfd-67cadfd6fc3f/kube-multus/0.log" Jul 27 10:01:56.476244 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:56.476206 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zvq9q_b6db3599-f13b-41f9-9bcb-692774d28e10/network-metrics-daemon/0.log" Jul 27 10:01:56.513124 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:56.513062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zvq9q_b6db3599-f13b-41f9-9bcb-692774d28e10/kube-rbac-proxy/0.log" Jul 27 10:01:57.723081 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.723056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/ovn-controller/0.log" Jul 27 10:01:57.756199 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.756170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/ovn-acl-logging/0.log" Jul 27 10:01:57.799094 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.799072 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/kube-rbac-proxy-node/0.log" Jul 27 10:01:57.828193 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.828167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 10:01:57.852425 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.852373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/northd/0.log" Jul 27 10:01:57.880325 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.880278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/nbdb/0.log" Jul 27 10:01:57.907402 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.907384 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/sbdb/0.log" Jul 27 10:01:57.958809 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:57.958785 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gpnc8_ee987323-9763-4df4-b1f4-6968732f2018/ovnkube-controller/0.log" Jul 27 10:01:59.381273 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:59.381244 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-5zh97_871a1665-96b2-41d6-8f38-570250588702/check-endpoints/0.log" Jul 27 10:01:59.422211 ip-10-0-134-146 kubenswrapper[2581]: I0727 10:01:59.422188 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gx68r_26c58a5a-8adf-42b6-9ebb-9b967e25a4d5/network-check-target-container/0.log"