Jul 14 14:28:00.381383 ip-10-0-134-71 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 14:28:00.381394 ip-10-0-134-71 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 14:28:00.381401 ip-10-0-134-71 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 14:28:00.381633 ip-10-0-134-71 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 14:28:09.988798 ip-10-0-134-71 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 14:28:09.988813 ip-10-0-134-71 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4048df1c65244edeb180391700dc279c -- Jul 14 14:29:35.980759 ip-10-0-134-71 systemd[1]: Starting Kubernetes Kubelet... Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.440854 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444934 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444945 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444948 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444951 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444954 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444957 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444960 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:29:36.467525 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444964 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444967 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444970 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444973 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444975 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444978 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444981 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444983 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444986 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444988 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444991 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444993 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444996 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.444998 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445001 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445004 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445006 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445016 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445019 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445021 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:29:36.469499 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445024 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445026 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445029 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445032 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445034 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445038 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445040 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445043 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445046 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445048 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445051 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445053 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445056 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445058 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445061 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445064 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445066 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445068 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445071 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:29:36.471666 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445074 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445077 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445079 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445081 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445084 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445088 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445092 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445095 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445098 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445101 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445105 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445108 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445112 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445114 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445117 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445120 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445123 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445126 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445130 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:29:36.485784 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445134 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445137 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445140 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445143 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445146 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445148 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445151 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445153 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445156 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445159 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445164 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445168 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445170 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445174 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445178 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445181 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445184 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445187 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:29:36.487897 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445189 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445192 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445195 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445198 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445200 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445203 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445205 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445208 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445211 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445213 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445215 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445218 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445220 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445223 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445225 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445905 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445912 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445915 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445918 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445921 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:29:36.489875 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445924 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445929 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445933 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445936 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445938 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445942 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445944 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445947 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445950 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445952 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445955 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445958 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445960 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445963 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445965 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445968 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445970 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445973 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445976 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445979 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:29:36.492224 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445981 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445984 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445986 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445989 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445991 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445994 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.445997 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446001 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446003 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446007 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446011 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446014 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446017 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446021 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446024 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446026 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446029 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446032 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446034 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:29:36.505821 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446037 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446040 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446042 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446044 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446047 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446050 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446052 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446055 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446057 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446060 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446064 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446067 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446071 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446074 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446077 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446079 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446082 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446085 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446087 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446091 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:29:36.507979 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446094 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446096 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446099 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446102 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446104 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446107 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446109 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446112 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446115 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446119 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446122 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446124 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446127 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446129 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446132 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446134 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446137 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446139 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446142 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446144 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:29:36.510047 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446147 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446150 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446152 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446154 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446157 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446159 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446162 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446164 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446167 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446172 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446175 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446177 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446180 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446182 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446185 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446529 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446534 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446537 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446540 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446543 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:29:36.512620 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446545 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446548 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446551 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446554 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446556 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446559 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446562 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446564 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446567 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446569 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446572 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446574 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446577 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446579 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446582 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446584 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446587 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446590 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446592 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446595 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:29:36.514380 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446597 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446604 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446607 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446610 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446613 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446616 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446618 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446621 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446624 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446627 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446630 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446633 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446636 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446639 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446641 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446644 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446646 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446649 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446652 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:29:36.523085 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446654 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:29:36.519417 ip-10-0-134-71 systemd[1]: Started Kubernetes Kubelet. Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446656 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446659 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446662 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446664 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446667 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446670 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446672 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446676 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446679 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446681 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446683 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446686 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446688 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446692 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446695 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446697 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446700 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446703 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446706 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:29:36.538040 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446708 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446711 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446715 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446718 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446721 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446724 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446727 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446730 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446733 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446735 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446738 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446740 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446743 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446745 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446748 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446750 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446753 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446755 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446757 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:29:36.555275 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446760 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446764 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446766 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446769 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446773 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446775 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446778 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446784 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446786 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446789 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446791 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446794 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446797 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446799 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446801 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.446804 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446869 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446880 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446885 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446889 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446894 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 14:29:36.561780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446897 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446901 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446905 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446908 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446911 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446914 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446917 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446920 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446923 2577 flags.go:64] FLAG: --cgroup-root="" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446926 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446929 2577 flags.go:64] FLAG: --client-ca-file="" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446932 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446937 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446942 2577 flags.go:64] FLAG: --cluster-domain="" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446945 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446948 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446951 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446954 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446959 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446961 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446964 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446967 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446971 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446973 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 14:29:36.564551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446976 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446979 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446982 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446986 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446988 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446991 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446994 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.446997 2577 flags.go:64] FLAG: --enable-server="true" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447000 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447004 2577 flags.go:64] FLAG: --event-burst="100" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447007 2577 flags.go:64] FLAG: --event-qps="50" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447009 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447012 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447015 2577 flags.go:64] FLAG: --eviction-hard="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447018 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447021 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447023 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447026 2577 flags.go:64] FLAG: --eviction-soft="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447029 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447032 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447036 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447039 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447042 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447045 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447048 2577 flags.go:64] FLAG: --feature-gates="" Jul 14 14:29:36.575337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447051 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447055 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447058 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447061 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447064 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447067 2577 flags.go:64] FLAG: --help="false" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447070 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-71.ec2.internal" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447073 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447076 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447079 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447082 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447085 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447088 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447091 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447094 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447096 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447107 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447111 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447114 2577 flags.go:64] FLAG: --kube-reserved="" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447116 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447119 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447122 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447125 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447128 2577 flags.go:64] FLAG: --lock-file="" Jul 14 14:29:36.728038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447130 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447133 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447136 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447147 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447150 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447153 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447156 2577 flags.go:64] FLAG: --logging-format="text" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447159 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447162 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447167 2577 flags.go:64] FLAG: --manifest-url="" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447169 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447174 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447176 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447180 2577 flags.go:64] FLAG: --max-pods="110" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447184 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447187 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447189 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447192 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447195 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447198 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447201 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447218 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447221 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447224 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 14:29:36.732031 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447227 2577 flags.go:64] FLAG: --pod-cidr="" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447230 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447236 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447239 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447242 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447245 2577 flags.go:64] FLAG: --port="10250" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447248 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447250 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef6be237b374c5a1" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447253 2577 flags.go:64] FLAG: --qos-reserved="" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447256 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447259 2577 flags.go:64] FLAG: --register-node="true" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447263 2577 flags.go:64] FLAG: --register-with-taints="" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447267 2577 flags.go:64] FLAG: --registry-burst="10" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447269 2577 flags.go:64] FLAG: --registry-qps="5" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447272 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447275 2577 flags.go:64] FLAG: --reserved-memory="" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447278 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447281 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447285 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447288 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447291 2577 flags.go:64] FLAG: --runonce="false" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447294 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447297 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447300 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447302 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 14:29:36.732854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447305 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447308 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447311 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447314 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447317 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447319 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447322 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447325 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447327 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447331 2577 flags.go:64] FLAG: --system-cgroups="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447333 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447338 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447341 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447344 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447348 2577 flags.go:64] FLAG: --tls-min-version="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447350 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447353 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447356 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447360 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447363 2577 flags.go:64] FLAG: --v="2" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447367 2577 flags.go:64] FLAG: --version="false" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447370 2577 flags.go:64] FLAG: --vmodule="" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447374 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.447377 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447498 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:29:36.734329 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447506 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447509 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447512 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447514 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447517 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447520 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447522 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447525 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447528 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447530 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447533 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447536 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447538 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447541 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447544 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447546 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447549 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447551 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447554 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447557 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:29:36.735112 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447559 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447563 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447567 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447570 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447573 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447577 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447579 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447582 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447584 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447587 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447589 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447592 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447596 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447598 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447601 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447604 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447606 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447609 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447612 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:29:36.735713 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447614 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447617 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447619 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447622 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447624 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447627 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447630 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447632 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447635 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447637 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447640 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447642 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447645 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447647 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447650 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447653 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447655 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447659 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447664 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447667 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:29:36.736306 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447670 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447672 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447676 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447679 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447682 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447686 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447689 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447691 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447694 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447696 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447699 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447702 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447704 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447706 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447709 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447712 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447714 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447716 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447719 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:29:36.736923 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447723 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447727 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447729 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447732 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447735 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447737 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447740 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447742 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447745 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447748 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447750 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447754 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447757 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447760 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447762 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447765 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447767 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447770 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447774 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:29:36.905679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.447777 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.448556 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.456946 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.456959 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.456977 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.456983 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457033 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457038 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457041 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457045 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457048 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457050 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457053 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457056 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:29:36.906437 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457060 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457064 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457068 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457072 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457076 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457079 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457082 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457085 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457088 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457091 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457093 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457096 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457098 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457101 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457103 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457106 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457109 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457111 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457114 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:29:36.907048 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457117 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457120 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457123 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457125 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457128 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457130 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457133 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457136 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457139 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457141 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457144 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457149 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457152 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457155 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457157 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457162 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457164 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457167 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457170 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:29:36.907642 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457172 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457175 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457177 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457180 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457183 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457185 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457188 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457190 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457193 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457195 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457198 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457201 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457204 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457206 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457209 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457211 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457214 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457216 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457219 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457222 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:29:36.908202 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457224 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457226 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457229 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457231 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457235 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457238 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457240 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457243 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457247 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457249 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457252 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457254 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457257 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457260 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457262 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457265 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457268 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457270 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457273 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457275 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:29:36.908754 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457278 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457280 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457283 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457285 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457288 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457290 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457293 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457295 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457297 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457300 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457302 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457305 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457308 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.457313 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457427 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:29:36.909313 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457431 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457435 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457438 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457441 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457444 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457447 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457451 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457453 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457456 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457459 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457462 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457464 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457467 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457485 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457489 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457492 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457494 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457497 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457501 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457504 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:29:36.909743 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457507 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457510 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457512 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457515 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457517 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457520 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457522 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457525 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457527 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457530 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457533 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457535 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457538 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457543 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457545 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457548 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457550 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457553 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457557 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457560 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:29:36.910301 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457562 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457566 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457570 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457573 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457576 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457579 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457582 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457584 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457588 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457590 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457593 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457596 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457599 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457601 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457604 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457606 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457609 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457611 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457614 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457617 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:29:36.910850 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457619 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457622 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457624 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457627 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457629 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457633 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457636 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457638 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457640 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457643 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457648 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457650 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457653 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457655 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457658 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457660 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457663 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457666 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457668 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:29:36.911423 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457671 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457673 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457677 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457680 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457683 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457686 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457688 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457691 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457694 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457697 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457699 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457701 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457704 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457707 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457709 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457711 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457714 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457717 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:29:36.911962 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:36.457722 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.457727 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.457810 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.460157 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.461897 2577 server.go:1019] "Starting client certificate rotation" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.461993 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.462032 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.467365 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.469018 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.478896 2577 log.go:25] "Validated CRI v1 runtime API" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.482922 2577 log.go:25] "Validated CRI v1 image API" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.483771 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 14:29:36.912491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.489076 2577 fs.go:135] Filesystem UUIDs: map[0d2300fa-4355-4d4d-b6d0-5ca6237b21c7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f7475337-4058-4492-863a-e134727a9fe8:/dev/nvme0n1p3] Jul 14 14:29:36.912850 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.489101 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.495413 2577 manager.go:216] Machine: {Timestamp:2026-07-14 14:29:36.493987259 +0000 UTC m=+0.376615152 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098329 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2940e848bb4757f8f0c886bdd01211 SystemUUID:ec2940e8-48bb-4757-f8f0-c886bdd01211 BootID:4048df1c-6524-4ede-b180-391700dc279c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:d7:f4:65:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:d7:f4:65:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:4c:76:98:78:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.495524 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.495592 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.498700 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.498981 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.499009 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 14:29:36.912950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.499835 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.499845 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.499852 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.500558 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.501827 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506543 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506653 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506673 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506681 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506694 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506702 2577 kubelet.go:398] "Adding apiserver pod source" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506710 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.506999 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.507015 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.511883 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.514634 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.514663 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515416 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515430 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515436 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515442 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515450 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515456 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515514 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515524 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515534 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515544 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515553 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515561 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515583 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.515588 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.518653 2577 server.go:1268] "Started kubelet" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.518775 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.518853 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.518853 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.520170 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.520361 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.521192 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.521290 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 14:29:36.913515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.521304 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.524542 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.526743 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.526760 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.526883 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527536 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527548 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527564 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527679 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527690 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527682 2577 factory.go:55] Registering systemd factory Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527711 2577 factory.go:223] Registration of the systemd container factory successfully Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527899 2577 factory.go:153] Registering CRI-O factory Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527910 2577 factory.go:223] Registration of the crio container factory successfully Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527963 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527978 2577 factory.go:103] Registering Raw factory Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.527988 2577 manager.go:1196] Started watching for new ooms in manager Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.528301 2577 manager.go:349] Starting recovery of all containers Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.531804 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.531881 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.531617 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c56b338c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.518592706 +0000 UTC m=+0.401220600,LastTimestamp:2026-07-14 14:29:36.518592706 +0000 UTC m=+0.401220600,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.539149 2577 manager.go:354] Recovery completed Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.544875 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.546570 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.546594 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.546610 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547057 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547069 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547077 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547084 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547689 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547712 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:36.914575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.547721 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.548970 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c585e4f24 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.546582308 +0000 UTC m=+0.429210203,LastTimestamp:2026-07-14 14:29:36.546582308 +0000 UTC m=+0.429210203,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.549180 2577 policy_none.go:49] "None policy: Start" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.549195 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.549208 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.551222 2577 policy_none.go:47] "Start" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.555811 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c585ea782 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.54660493 +0000 UTC m=+0.429232823,LastTimestamp:2026-07-14 14:29:36.54660493 +0000 UTC m=+0.429232823,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.564621 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c585ecd49 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-71.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.546614601 +0000 UTC m=+0.429242497,LastTimestamp:2026-07-14 14:29:36.546614601 +0000 UTC m=+0.429242497,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.569614 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-71.ec2.internal.18c22e5c585e4f24\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c585e4f24 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.546582308 +0000 UTC m=+0.429210203,LastTimestamp:2026-07-14 14:29:36.547700099 +0000 UTC m=+0.430327992,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.097122 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.576132 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2q6w4" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.580911 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-71.ec2.internal.18c22e5c585ea782\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c585ea782 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.54660493 +0000 UTC m=+0.429232823,LastTimestamp:2026-07-14 14:29:36.547716249 +0000 UTC m=+0.430344142,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.583802 2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-71.ec2.internal.18c22e5c585ecd49\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c585ecd49 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-71.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.546614601 +0000 UTC m=+0.429242497,LastTimestamp:2026-07-14 14:29:36.547725563 +0000 UTC m=+0.430353455,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.585295 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2q6w4" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596020 2577 manager.go:337] "Starting Device Plugin manager" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.596042 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596050 2577 server.go:87] "Starting device plugin registration server" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596261 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596287 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596353 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596434 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.596443 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.596914 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.596960 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.600392 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.ec2.internal.18c22e5c5b71b200 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.ec2.internal,UID:ip-10-0-134-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.ec2.internal,},FirstTimestamp:2026-07-14 14:29:36.598184448 +0000 UTC m=+0.480812343,LastTimestamp:2026-07-14 14:29:36.598184448 +0000 UTC m=+0.480812343,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.ec2.internal,}" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.618283 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.619337 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.619371 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.619391 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.619424 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 14:29:37.098044 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.633090 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.697021 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.697983 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.698007 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.698019 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.698037 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.713396 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.713411 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-71.ec2.internal\": node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.720158 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal"] Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.720205 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.721331 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.721361 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.721370 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.723735 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.723842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.723870 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.724331 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.724358 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.724331 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.724389 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.724402 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.724369 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.726649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.726669 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.727282 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.727308 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.727322 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.732378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a682348621e758bd4e389d3056fad38-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal\" (UID: \"5a682348621e758bd4e389d3056fad38\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.098628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.732397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a682348621e758bd4e389d3056fad38-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal\" (UID: \"5a682348621e758bd4e389d3056fad38\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.732413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7315c1a2bc3628ff72348aa227de3e72-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.ec2.internal\" (UID: \"7315c1a2bc3628ff72348aa227de3e72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.761114 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.779136 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-71.ec2.internal\" not found" node="ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.784362 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-71.ec2.internal\" not found" node="ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.832524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a682348621e758bd4e389d3056fad38-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal\" (UID: \"5a682348621e758bd4e389d3056fad38\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.832543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a682348621e758bd4e389d3056fad38-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal\" (UID: \"5a682348621e758bd4e389d3056fad38\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.832561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7315c1a2bc3628ff72348aa227de3e72-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.ec2.internal\" (UID: \"7315c1a2bc3628ff72348aa227de3e72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.832591 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7315c1a2bc3628ff72348aa227de3e72-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.ec2.internal\" (UID: \"7315c1a2bc3628ff72348aa227de3e72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.832611 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a682348621e758bd4e389d3056fad38-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal\" (UID: \"5a682348621e758bd4e389d3056fad38\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:36.832628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a682348621e758bd4e389d3056fad38-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal\" (UID: \"5a682348621e758bd4e389d3056fad38\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.862185 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:36.964219 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:37.064451 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:37.081605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.099378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:37.087233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" Jul 14 14:29:37.244272 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:37.165161 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.417146 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:37.265785 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:37.417146 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:37.366249 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.139471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.035847 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 14:29:39.139471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.035959 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 14:29:39.139471 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.042105 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.261224 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.142743 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.261224 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.165927 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 14:24:38 +0000 UTC" deadline="2028-01-09 19:00:49.655691272 +0000 UTC" Jul 14 14:29:39.261224 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.165950 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13060h31m10.489743827s" Jul 14 14:29:39.261224 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.241112 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:29:39.261224 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.242849 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.384553 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.276995 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:29:39.384553 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.277994 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:29:39.384553 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.278023 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:29:39.384553 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.278034 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:29:39.384553 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.343487 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.527334 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:39.416314 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7315c1a2bc3628ff72348aa227de3e72.slice/crio-e2b68b855d72e17d398c66c3a3010326dced2dd3cb5f31423816af1e874b2977 WatchSource:0}: Error finding container e2b68b855d72e17d398c66c3a3010326dced2dd3cb5f31423816af1e874b2977: Status 404 returned error can't find the container with id e2b68b855d72e17d398c66c3a3010326dced2dd3cb5f31423816af1e874b2977 Jul 14 14:29:39.527334 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:39.416864 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a682348621e758bd4e389d3056fad38.slice/crio-ed7c04a352520f479674d7d7fdd117e1c6a35fb7cceaeee6105053358109e0d3 WatchSource:0}: Error finding container ed7c04a352520f479674d7d7fdd117e1c6a35fb7cceaeee6105053358109e0d3: Status 404 returned error can't find the container with id ed7c04a352520f479674d7d7fdd117e1c6a35fb7cceaeee6105053358109e0d3 Jul 14 14:29:39.527334 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.422170 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:29:39.527334 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.444246 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.544434 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.546514 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:39.644764 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-71.ec2.internal\" not found" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.693250 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.702226 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.719279 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.720101 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" Jul 14 14:29:39.732815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.727127 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:39.997675 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.083508 2577 apiserver.go:52] "Watching apiserver" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.092665 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.095680 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l","openshift-cluster-node-tuning-operator/tuned-9f2jv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal","openshift-network-operator/iptables-alerter-xfjmb","openshift-ovn-kubernetes/ovnkube-node-qq9kk","kube-system/konnectivity-agent-248pl","kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal","openshift-dns/node-resolver-4tpnl","openshift-image-registry/node-ca-lkmv6","openshift-multus/multus-additional-cni-plugins-vwnw8","openshift-multus/multus-b8x8z","openshift-multus/network-metrics-daemon-42nkf","openshift-network-diagnostics/network-check-target-vq5qb","kube-system/global-pull-secret-syncer-qtgq5"] Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.099352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.101361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.101427 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.102494 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.103380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.103424 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.105539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.105552 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.107793 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.107838 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.107903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.107933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.107977 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.108088 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sphx5\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.108781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7c6gv\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.108819 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.108838 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.109028 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.111954 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.110269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.113704 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.112472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.115852 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.114654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.117306 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.116189 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 14:29:40.117306 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.116834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119186 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119293 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119318 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119516 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119570 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.119702 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.120296 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g5l24\"" Jul 14 14:29:40.120851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.120305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-kubelet-config\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-system-cni-dir\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-cnibin\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-os-release\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121162 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz4sd\" (UniqueName: \"kubernetes.io/projected/fc09f6df-0421-414e-b5a6-8e813ee902d0-kube-api-access-dz4sd\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-dbus\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.121762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.121630 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.122846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.122038 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.122846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.122294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.122846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.122314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 14:29:40.122846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.122325 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q4jln\"" Jul 14 14:29:40.122846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.122342 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-85g6v\"" Jul 14 14:29:40.122846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.122687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.123937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.123376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 14:29:40.123937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.123466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-48vpr\"" Jul 14 14:29:40.123937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.123611 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnbhk\"" Jul 14 14:29:40.127276 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.126552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.127276 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.126655 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:40.128367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.127713 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 14:29:40.128367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.127798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 14:29:40.128367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.128001 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 14:29:40.128367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.128088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 14:29:40.128367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.128276 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhdnq\"" Jul 14 14:29:40.129937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.129718 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4kfgr\"" Jul 14 14:29:40.207178 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.133350 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 14:29:40.207178 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.171964 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bzlhl" Jul 14 14:29:40.207178 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.186586 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bzlhl" Jul 14 14:29:40.207178 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.203887 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-kubelet-config\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-cnibin\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-var-lib-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221898 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-kubelet-config\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-ovnkube-config\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221913 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-cnibin\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ab2b228-5d1d-42e5-85b0-f27fb40de843-agent-certs\") pod \"konnectivity-agent-248pl\" (UID: \"1ab2b228-5d1d-42e5-85b0-f27fb40de843\") " pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-kubernetes\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.221995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10382172-3705-48c8-bcf0-200aff807c59-host\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-device-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbd6\" (UniqueName: \"kubernetes.io/projected/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-kube-api-access-qvbd6\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-os-release\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.274840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-cni-bin\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-hostroot\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7w9v\" (UniqueName: \"kubernetes.io/projected/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-kube-api-access-q7w9v\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-kubelet\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysctl-d\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhgb\" (UniqueName: \"kubernetes.io/projected/10382172-3705-48c8-bcf0-200aff807c59-kube-api-access-dkhgb\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222402 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-systemd-units\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-slash\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-ovn\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-var-lib-kubelet\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jnw7\" (UniqueName: \"kubernetes.io/projected/639b1d12-b575-4032-b484-15237f204edc-kube-api-access-9jnw7\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.275675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10382172-3705-48c8-bcf0-200aff807c59-serviceca\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-socket-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-etc-kubernetes\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a806b8-859e-4313-b082-b9e332805c36-ovn-node-metrics-cert\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/639b1d12-b575-4032-b484-15237f204edc-tmp\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-registration-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-cni-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-etc-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-env-overrides\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-run\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-sys\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-socket-dir-parent\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/639b1d12-b575-4032-b484-15237f204edc-etc-tuned\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-log-socket\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.277388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-host\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-netns\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-multus-certs\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.222998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b307d70e-2f70-4fed-82be-60927c1595d8-host-slash\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-sys-fs\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-kubelet\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-system-cni-dir\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcf4x\" (UniqueName: \"kubernetes.io/projected/85a806b8-859e-4313-b082-b9e332805c36-kube-api-access-dcf4x\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz4sd\" (UniqueName: \"kubernetes.io/projected/fc09f6df-0421-414e-b5a6-8e813ee902d0-kube-api-access-dz4sd\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-ovnkube-script-lib\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-systemd\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-system-cni-dir\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae7f047-c5a7-46f2-b739-7380f69e766c-tmp-dir\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.278208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpskc\" (UniqueName: \"kubernetes.io/projected/9ae7f047-c5a7-46f2-b739-7380f69e766c-kube-api-access-tpskc\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-cnibin\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-cni-multus\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-systemd\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-dbus\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-dbus\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-run-ovn-kubernetes\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-modprobe-d\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-k8s-cni-cncf-io\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-cni-bin\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-cni-binary-copy\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slkfb\" (UniqueName: \"kubernetes.io/projected/b307d70e-2f70-4fed-82be-60927c1595d8-kube-api-access-slkfb\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.280824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.223981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-node-log\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ab2b228-5d1d-42e5-85b0-f27fb40de843-konnectivity-ca\") pod \"konnectivity-agent-248pl\" (UID: \"1ab2b228-5d1d-42e5-85b0-f27fb40de843\") " pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-conf-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-os-release\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ae7f047-c5a7-46f2-b739-7380f69e766c-hosts-file\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-daemon-config\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.224205 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224158 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.224304 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:40.724276716 +0000 UTC m=+3.031922150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-run-netns\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.282102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc09f6df-0421-414e-b5a6-8e813ee902d0-os-release\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b307d70e-2f70-4fed-82be-60927c1595d8-iptables-alerter-script\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-cni-netd\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysconfig\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysctl-conf\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-lib-modules\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-system-cni-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrmnn\" (UniqueName: \"kubernetes.io/projected/799ad4f3-3e43-40aa-87d9-cb11ce14c188-kube-api-access-mrmnn\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.224969 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.225028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc09f6df-0421-414e-b5a6-8e813ee902d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.241136 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.241157 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:29:40.284602 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.241169 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:40.285400 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.241221 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:29:40.741203995 +0000 UTC m=+3.048849436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:40.285400 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.241274 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 14:29:40.285400 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.245760 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz4sd\" (UniqueName: \"kubernetes.io/projected/fc09f6df-0421-414e-b5a6-8e813ee902d0-kube-api-access-dz4sd\") pod \"multus-additional-cni-plugins-vwnw8\" (UID: \"fc09f6df-0421-414e-b5a6-8e813ee902d0\") " pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.286761 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.286473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" event={"ID":"7315c1a2bc3628ff72348aa227de3e72","Type":"ContainerStarted","Data":"e2b68b855d72e17d398c66c3a3010326dced2dd3cb5f31423816af1e874b2977"} Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.288085 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" event={"ID":"5a682348621e758bd4e389d3056fad38","Type":"ContainerStarted","Data":"ed7c04a352520f479674d7d7fdd117e1c6a35fb7cceaeee6105053358109e0d3"} Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ae7f047-c5a7-46f2-b739-7380f69e766c-hosts-file\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-daemon-config\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-run-netns\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325433 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b307d70e-2f70-4fed-82be-60927c1595d8-iptables-alerter-script\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-cni-netd\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysconfig\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysctl-conf\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-lib-modules\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-system-cni-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.359974 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrmnn\" (UniqueName: \"kubernetes.io/projected/799ad4f3-3e43-40aa-87d9-cb11ce14c188-kube-api-access-mrmnn\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-var-lib-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-ovnkube-config\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ab2b228-5d1d-42e5-85b0-f27fb40de843-agent-certs\") pod \"konnectivity-agent-248pl\" (UID: \"1ab2b228-5d1d-42e5-85b0-f27fb40de843\") " pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-kubernetes\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10382172-3705-48c8-bcf0-200aff807c59-host\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-device-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbd6\" (UniqueName: \"kubernetes.io/projected/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-kube-api-access-qvbd6\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-os-release\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-cni-bin\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-hostroot\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7w9v\" (UniqueName: \"kubernetes.io/projected/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-kube-api-access-q7w9v\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-kubelet\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysctl-d\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.362793 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325968 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-daemon-config\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.325985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhgb\" (UniqueName: \"kubernetes.io/projected/10382172-3705-48c8-bcf0-200aff807c59-kube-api-access-dkhgb\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ae7f047-c5a7-46f2-b739-7380f69e766c-hosts-file\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-systemd-units\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-slash\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-ovn\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326115 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-run-netns\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-var-lib-kubelet\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jnw7\" (UniqueName: \"kubernetes.io/projected/639b1d12-b575-4032-b484-15237f204edc-kube-api-access-9jnw7\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10382172-3705-48c8-bcf0-200aff807c59-serviceca\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-socket-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-etc-kubernetes\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a806b8-859e-4313-b082-b9e332805c36-ovn-node-metrics-cert\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/639b1d12-b575-4032-b484-15237f204edc-tmp\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.364048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-registration-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-cni-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-etc-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-env-overrides\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-run\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-sys\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-socket-dir-parent\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/639b1d12-b575-4032-b484-15237f204edc-etc-tuned\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-log-socket\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-host\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b307d70e-2f70-4fed-82be-60927c1595d8-iptables-alerter-script\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-netns\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-multus-certs\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326646 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10382172-3705-48c8-bcf0-200aff807c59-host\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b307d70e-2f70-4fed-82be-60927c1595d8-host-slash\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.367437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-sys-fs\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-device-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-sys-fs\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-kubelet\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326783 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-cni-netd\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcf4x\" (UniqueName: \"kubernetes.io/projected/85a806b8-859e-4313-b082-b9e332805c36-kube-api-access-dcf4x\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-ovnkube-script-lib\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-systemd\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae7f047-c5a7-46f2-b739-7380f69e766c-tmp-dir\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326894 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysctl-conf\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpskc\" (UniqueName: \"kubernetes.io/projected/9ae7f047-c5a7-46f2-b739-7380f69e766c-kube-api-access-tpskc\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-cnibin\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-cni-multus\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-systemd\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.368297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326994 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-lib-modules\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-run-ovn-kubernetes\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327041 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-system-cni-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-modprobe-d\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-k8s-cni-cncf-io\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-cni-bin\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327115 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-modprobe-d\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-cni-binary-copy\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slkfb\" (UniqueName: \"kubernetes.io/projected/b307d70e-2f70-4fed-82be-60927c1595d8-kube-api-access-slkfb\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-node-log\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ab2b228-5d1d-42e5-85b0-f27fb40de843-konnectivity-ca\") pod \"konnectivity-agent-248pl\" (UID: \"1ab2b228-5d1d-42e5-85b0-f27fb40de843\") " pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-conf-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327353 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-conf-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-os-release\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.371058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327427 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-cni-bin\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327485 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-hostroot\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327582 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-var-lib-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327679 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-kubelet\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.327798 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysctl-d\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328060 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328088 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-ovnkube-config\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328110 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-systemd-units\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328151 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-slash\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.326073 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-kubernetes\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.328217 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.328273 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:40.828257976 +0000 UTC m=+3.135903423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-socket-dir-parent\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-netns\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-var-lib-kubelet\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.372096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-systemd\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-cni-multus\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-registration-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-cni-bin\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328514 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-systemd\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-run\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328581 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-host-run-ovn-kubernetes\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328615 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-cnibin\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328623 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-multus-certs\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328641 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-log-socket\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328657 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b307d70e-2f70-4fed-82be-60927c1595d8-host-slash\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae7f047-c5a7-46f2-b739-7380f69e766c-tmp-dir\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328704 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-node-log\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328852 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-etc-openvswitch\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.374000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.328901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-host\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-env-overrides\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ab2b228-5d1d-42e5-85b0-f27fb40de843-konnectivity-ca\") pod \"konnectivity-agent-248pl\" (UID: \"1ab2b228-5d1d-42e5-85b0-f27fb40de843\") " pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10382172-3705-48c8-bcf0-200aff807c59-serviceca\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329616 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85a806b8-859e-4313-b082-b9e332805c36-run-ovn\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-etc-sysconfig\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329651 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-var-lib-kubelet\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329707 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-etc-kubernetes\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-socket-dir\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329719 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-multus-cni-dir\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.329752 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-host-run-k8s-cni-cncf-io\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.330341 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/639b1d12-b575-4032-b484-15237f204edc-sys\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.331084 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-cni-binary-copy\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.331394 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/639b1d12-b575-4032-b484-15237f204edc-etc-tuned\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.331807 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85a806b8-859e-4313-b082-b9e332805c36-ovnkube-script-lib\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.375021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.336024 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/639b1d12-b575-4032-b484-15237f204edc-tmp\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.338004 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a806b8-859e-4313-b082-b9e332805c36-ovn-node-metrics-cert\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.338261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ab2b228-5d1d-42e5-85b0-f27fb40de843-agent-certs\") pod \"konnectivity-agent-248pl\" (UID: \"1ab2b228-5d1d-42e5-85b0-f27fb40de843\") " pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.356101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbd6\" (UniqueName: \"kubernetes.io/projected/a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b-kube-api-access-qvbd6\") pod \"aws-ebs-csi-driver-node-drx7l\" (UID: \"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.356735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slkfb\" (UniqueName: \"kubernetes.io/projected/b307d70e-2f70-4fed-82be-60927c1595d8-kube-api-access-slkfb\") pod \"iptables-alerter-xfjmb\" (UID: \"b307d70e-2f70-4fed-82be-60927c1595d8\") " pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.358219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7w9v\" (UniqueName: \"kubernetes.io/projected/f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9-kube-api-access-q7w9v\") pod \"multus-b8x8z\" (UID: \"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9\") " pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.358264 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhgb\" (UniqueName: \"kubernetes.io/projected/10382172-3705-48c8-bcf0-200aff807c59-kube-api-access-dkhgb\") pod \"node-ca-lkmv6\" (UID: \"10382172-3705-48c8-bcf0-200aff807c59\") " pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.358801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcf4x\" (UniqueName: \"kubernetes.io/projected/85a806b8-859e-4313-b082-b9e332805c36-kube-api-access-dcf4x\") pod \"ovnkube-node-qq9kk\" (UID: \"85a806b8-859e-4313-b082-b9e332805c36\") " pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.359921 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpskc\" (UniqueName: \"kubernetes.io/projected/9ae7f047-c5a7-46f2-b739-7380f69e766c-kube-api-access-tpskc\") pod \"node-resolver-4tpnl\" (UID: \"9ae7f047-c5a7-46f2-b739-7380f69e766c\") " pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.360632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jnw7\" (UniqueName: \"kubernetes.io/projected/639b1d12-b575-4032-b484-15237f204edc-kube-api-access-9jnw7\") pod \"tuned-9f2jv\" (UID: \"639b1d12-b575-4032-b484-15237f204edc\") " pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.377853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.362320 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrmnn\" (UniqueName: \"kubernetes.io/projected/799ad4f3-3e43-40aa-87d9-cb11ce14c188-kube-api-access-mrmnn\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.408292 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.422303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xfjmb" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.434518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.436426 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc09f6df_0421_414e_b5a6_8e813ee902d0.slice/crio-9ddc57ada88fa47bc8315b21ea41c7b1dab2a8c8eb38bbcb7c353580e9c65fe4 WatchSource:0}: Error finding container 9ddc57ada88fa47bc8315b21ea41c7b1dab2a8c8eb38bbcb7c353580e9c65fe4: Status 404 returned error can't find the container with id 9ddc57ada88fa47bc8315b21ea41c7b1dab2a8c8eb38bbcb7c353580e9c65fe4 Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.437725 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-248pl" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.438763 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb307d70e_2f70_4fed_82be_60927c1595d8.slice/crio-8ebf23427b85ab6cdb844e467bf8fbc7731909d65b4355e4d7a7e3adbecf0fb0 WatchSource:0}: Error finding container 8ebf23427b85ab6cdb844e467bf8fbc7731909d65b4355e4d7a7e3adbecf0fb0: Status 404 returned error can't find the container with id 8ebf23427b85ab6cdb844e467bf8fbc7731909d65b4355e4d7a7e3adbecf0fb0 Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.444580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lkmv6" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.449985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tpnl" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.457674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.460864 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a806b8_859e_4313_b082_b9e332805c36.slice/crio-3ee3b62daae4f0aabe1bec0420f7101722c715b864e7c9918021ad13484ad84e WatchSource:0}: Error finding container 3ee3b62daae4f0aabe1bec0420f7101722c715b864e7c9918021ad13484ad84e: Status 404 returned error can't find the container with id 3ee3b62daae4f0aabe1bec0420f7101722c715b864e7c9918021ad13484ad84e Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.462774 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab2b228_5d1d_42e5_85b0_f27fb40de843.slice/crio-70e4dfee68896d76897baf43641b5bea5035f2a297863bdfe75067b175d01c68 WatchSource:0}: Error finding container 70e4dfee68896d76897baf43641b5bea5035f2a297863bdfe75067b175d01c68: Status 404 returned error can't find the container with id 70e4dfee68896d76897baf43641b5bea5035f2a297863bdfe75067b175d01c68 Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.464380 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10382172_3705_48c8_bcf0_200aff807c59.slice/crio-8ccd6d41b2bdad03e0aca542cae4cbfed0e170f6970f2f31390892b05459fc98 WatchSource:0}: Error finding container 8ccd6d41b2bdad03e0aca542cae4cbfed0e170f6970f2f31390892b05459fc98: Status 404 returned error can't find the container with id 8ccd6d41b2bdad03e0aca542cae4cbfed0e170f6970f2f31390892b05459fc98 Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.464488 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.470219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b8x8z" Jul 14 14:29:40.476033 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.475743 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639b1d12_b575_4032_b484_15237f204edc.slice/crio-e6c43505b93e417d39309aa8e250bd1733ced2dcf48df38e5950492b0bef6f15 WatchSource:0}: Error finding container e6c43505b93e417d39309aa8e250bd1733ced2dcf48df38e5950492b0bef6f15: Status 404 returned error can't find the container with id e6c43505b93e417d39309aa8e250bd1733ced2dcf48df38e5950492b0bef6f15 Jul 14 14:29:40.543849 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.486966 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a8b98b_5e1b_4634_bbd8_c8a3bf14be9b.slice/crio-6d5f166b0b09accaa9fcf8f6585b312664c8037ddf24042d4019b68bc88e47e9 WatchSource:0}: Error finding container 6d5f166b0b09accaa9fcf8f6585b312664c8037ddf24042d4019b68bc88e47e9: Status 404 returned error can't find the container with id 6d5f166b0b09accaa9fcf8f6585b312664c8037ddf24042d4019b68bc88e47e9 Jul 14 14:29:40.543849 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:29:40.488743 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b694f2_18ef_4c8c_b7a8_97a24dfca8f9.slice/crio-ffbead2b473b2f9d5a8bae6e6245bf7a5d4ce8439bbe8612ba5f91733bd3e301 WatchSource:0}: Error finding container ffbead2b473b2f9d5a8bae6e6245bf7a5d4ce8439bbe8612ba5f91733bd3e301: Status 404 returned error can't find the container with id ffbead2b473b2f9d5a8bae6e6245bf7a5d4ce8439bbe8612ba5f91733bd3e301 Jul 14 14:29:40.731011 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.730979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:40.731155 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.731135 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:40.731224 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.731212 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:41.731190929 +0000 UTC m=+4.038836375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:40.831932 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.831899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:40.832084 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:40.831974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:40.832084 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.832066 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:29:40.832208 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.832090 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:29:40.832208 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.832103 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:40.832208 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.832105 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:40.832208 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.832167 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:41.832148413 +0000 UTC m=+4.139793864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:40.832208 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:40.832187 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:29:41.832177232 +0000 UTC m=+4.139822674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:41.190333 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.190285 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 14:24:40 +0000 UTC" deadline="2027-12-13 06:46:18.179933762 +0000 UTC" Jul 14 14:29:41.190333 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.190327 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12400h16m36.98961211s" Jul 14 14:29:41.290798 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.290767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b8x8z" event={"ID":"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9","Type":"ContainerStarted","Data":"ffbead2b473b2f9d5a8bae6e6245bf7a5d4ce8439bbe8612ba5f91733bd3e301"} Jul 14 14:29:41.291882 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.291858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" event={"ID":"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b","Type":"ContainerStarted","Data":"6d5f166b0b09accaa9fcf8f6585b312664c8037ddf24042d4019b68bc88e47e9"} Jul 14 14:29:41.292894 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.292870 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerStarted","Data":"9ddc57ada88fa47bc8315b21ea41c7b1dab2a8c8eb38bbcb7c353580e9c65fe4"} Jul 14 14:29:41.293960 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.293940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" event={"ID":"639b1d12-b575-4032-b484-15237f204edc","Type":"ContainerStarted","Data":"e6c43505b93e417d39309aa8e250bd1733ced2dcf48df38e5950492b0bef6f15"} Jul 14 14:29:41.294971 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.294951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tpnl" event={"ID":"9ae7f047-c5a7-46f2-b739-7380f69e766c","Type":"ContainerStarted","Data":"56b71f427b6d4859f9d6ba2cb35026bc9d87b7244c87cb12aad6a2b1fde9f5b6"} Jul 14 14:29:41.295953 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.295924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lkmv6" event={"ID":"10382172-3705-48c8-bcf0-200aff807c59","Type":"ContainerStarted","Data":"8ccd6d41b2bdad03e0aca542cae4cbfed0e170f6970f2f31390892b05459fc98"} Jul 14 14:29:41.296844 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.296827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-248pl" event={"ID":"1ab2b228-5d1d-42e5-85b0-f27fb40de843","Type":"ContainerStarted","Data":"70e4dfee68896d76897baf43641b5bea5035f2a297863bdfe75067b175d01c68"} Jul 14 14:29:41.297978 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.297950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"3ee3b62daae4f0aabe1bec0420f7101722c715b864e7c9918021ad13484ad84e"} Jul 14 14:29:41.301736 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.301710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xfjmb" event={"ID":"b307d70e-2f70-4fed-82be-60927c1595d8","Type":"ContainerStarted","Data":"8ebf23427b85ab6cdb844e467bf8fbc7731909d65b4355e4d7a7e3adbecf0fb0"} Jul 14 14:29:41.740580 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.739909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:41.740580 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.740098 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:41.740580 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.740155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:43.740137961 +0000 UTC m=+6.047783405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:41.840422 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.840388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:41.840608 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:41.840478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:41.840671 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.840606 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:41.840671 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.840664 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:43.840644884 +0000 UTC m=+6.148290327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:41.841196 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.841174 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:29:41.841196 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.841199 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:29:41.841347 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.841212 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:41.841347 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:41.841258 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:29:43.841242963 +0000 UTC m=+6.148888405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:42.190581 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:42.190494 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 14:24:40 +0000 UTC" deadline="2028-03-24 00:27:40.06024312 +0000 UTC" Jul 14 14:29:42.190581 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:42.190560 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14841h57m57.869695553s" Jul 14 14:29:42.200711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:42.197661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:42.200711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:42.197685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:42.200711 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:42.197775 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:42.200711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:42.197866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:42.200711 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:42.198002 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:42.200711 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:42.198083 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:43.315857 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.315007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" event={"ID":"7315c1a2bc3628ff72348aa227de3e72","Type":"ContainerStarted","Data":"16c0fa17f5bc1ec7cc156e5f63da9f0eba7aa47d0b6eda342fd2a34aa07d70f5"} Jul 14 14:29:43.321573 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.321545 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a682348621e758bd4e389d3056fad38" containerID="a3b9d00d1f48d3e6ef993f9d0c5ed7d41f98dd98411de6b71eaf8a0a0d2d4f88" exitCode=0 Jul 14 14:29:43.321686 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.321592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" event={"ID":"5a682348621e758bd4e389d3056fad38","Type":"ContainerDied","Data":"a3b9d00d1f48d3e6ef993f9d0c5ed7d41f98dd98411de6b71eaf8a0a0d2d4f88"} Jul 14 14:29:43.333480 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.333174 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.ec2.internal" podStartSLOduration=4.333155821 podStartE2EDuration="4.333155821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:29:43.332560736 +0000 UTC m=+5.640206187" watchObservedRunningTime="2026-07-14 14:29:43.333155821 +0000 UTC m=+5.640801273" Jul 14 14:29:43.757306 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.757272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:43.757522 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.757466 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:43.757598 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.757526 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:47.7575083 +0000 UTC m=+10.065153728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:43.858473 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.858409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:43.858616 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:43.858489 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:43.858672 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.858618 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:43.858714 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.858679 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:47.85866048 +0000 UTC m=+10.166305923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:43.859092 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.859073 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:29:43.859216 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.859097 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:29:43.859216 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.859109 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:43.859216 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:43.859153 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:29:47.859138727 +0000 UTC m=+10.166784170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:44.195565 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:44.195529 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:44.195733 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:44.195675 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:44.196112 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:44.196075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:44.196205 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:44.196177 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:44.200267 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:44.198187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:44.200267 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:44.198285 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:46.198480 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:46.197650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:46.198480 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:46.197790 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:46.198480 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:46.198202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:46.198480 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:46.198288 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:46.198480 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:46.198343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:46.198480 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:46.198412 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:47.793751 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:47.793618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:47.794226 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.793766 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:47.794226 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.793815 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:55.793802788 +0000 UTC m=+18.101448219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:47.894915 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:47.894862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:47.895069 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:47.894928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:47.895069 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.895012 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:29:47.895069 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.895032 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:29:47.895069 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.895039 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:47.895069 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.895044 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:47.895323 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.895092 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:29:55.895073251 +0000 UTC m=+18.202718697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:47.895323 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:47.895110 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:29:55.895099823 +0000 UTC m=+18.202745251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:48.196471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:48.196024 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:48.196471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:48.196039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:48.196471 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:48.196139 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:48.196471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:48.196181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:48.196471 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:48.196282 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:48.196471 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:48.196362 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:50.196063 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:50.195576 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:50.196063 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:50.195580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:50.196063 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:50.195705 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:50.196063 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:50.195808 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:50.196063 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:50.195852 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:50.196063 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:50.195918 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:52.195002 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:52.194904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:52.195002 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:52.194938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:52.195002 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:52.194904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:52.195529 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:52.195040 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:52.195529 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:52.195153 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:52.195529 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:52.195233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:54.194847 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:54.194816 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:54.195274 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:54.194818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:54.195274 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:54.194911 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:54.195274 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:54.194986 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:54.195274 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:54.195040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:54.195274 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:54.195129 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:55.853358 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:55.853318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:55.853867 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.853480 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:55.853867 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.853548 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:11.853528501 +0000 UTC m=+34.161173943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:29:55.954025 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:55.953991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:55.954193 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:55.954056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:55.954193 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.954153 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:55.954193 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.954171 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:29:55.954193 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.954190 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:29:55.954406 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.954199 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:55.954406 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.954221 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:11.954205175 +0000 UTC m=+34.261850603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:29:55.954406 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:55.954241 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:30:11.95423043 +0000 UTC m=+34.261875858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:29:56.194867 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:56.194837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:56.195037 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:56.194837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:56.195037 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:56.194950 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:29:56.195037 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:56.194988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:56.195198 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:56.195084 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:56.195250 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:56.195215 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:58.195524 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:58.195493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:29:58.195524 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:58.195529 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:29:58.196020 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:29:58.195509 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:29:58.196020 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:58.195680 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:29:58.196020 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:58.195778 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:29:58.196020 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:29:58.195855 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:00.195519 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.194697 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:00.195519 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:00.195017 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:00.195519 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.194696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:00.195519 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:00.195121 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:00.195519 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.194697 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:00.195519 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:00.195188 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:00.356442 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.356415 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" event={"ID":"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b","Type":"ContainerStarted","Data":"bdabb844d706227e7712eca0038acad50fdca1d30a27a858c511b756eef1ef8f"} Jul 14 14:30:00.357942 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.357918 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc09f6df-0421-414e-b5a6-8e813ee902d0" containerID="bc360b06c478dbe3ac2d72b19c9963b59edfe5b955192eff0fce1cc6ff4fed60" exitCode=0 Jul 14 14:30:00.358043 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.357999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerDied","Data":"bc360b06c478dbe3ac2d72b19c9963b59edfe5b955192eff0fce1cc6ff4fed60"} Jul 14 14:30:00.359526 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.359500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" event={"ID":"639b1d12-b575-4032-b484-15237f204edc","Type":"ContainerStarted","Data":"0d8d3308f17f05ba8875d2e5b729c86883c856ca6a42a83084f85291efb5bbbe"} Jul 14 14:30:00.361110 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.361089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tpnl" event={"ID":"9ae7f047-c5a7-46f2-b739-7380f69e766c","Type":"ContainerStarted","Data":"06bc941a2d55274ae074df8631263a9d9e40a9b38f3ff8532b5ac4382b470deb"} Jul 14 14:30:00.362740 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.362713 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lkmv6" event={"ID":"10382172-3705-48c8-bcf0-200aff807c59","Type":"ContainerStarted","Data":"f4e4e180c75e6560e74d628f2352186fbcd74de1119adbac21300c6f6e2a76f4"} Jul 14 14:30:00.364088 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.364067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-248pl" event={"ID":"1ab2b228-5d1d-42e5-85b0-f27fb40de843","Type":"ContainerStarted","Data":"68bd0934ba3063e479e34c8d64cca70892df22b37a6a76b046448c43877c6a93"} Jul 14 14:30:00.366185 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.366159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:30:00.366538 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.366521 2577 generic.go:356] "Generic (PLEG): container finished" podID="85a806b8-859e-4313-b082-b9e332805c36" containerID="5d0606f346bdb0188166ea1383cddef709fa84563abb18c832a26c76cfa58725" exitCode=1 Jul 14 14:30:00.366628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.366573 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"34c037725fb2d9d3b8d6a8e8bf3050a18eee7f372d2914f417b2554991d38c9d"} Jul 14 14:30:00.366687 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.366632 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"ddb2f2db8cfeabd4a89105accec83c0cb75ce0274618555d38b75e4f929cde6e"} Jul 14 14:30:00.366687 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.366668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerDied","Data":"5d0606f346bdb0188166ea1383cddef709fa84563abb18c832a26c76cfa58725"} Jul 14 14:30:00.366787 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.366715 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"fc0081d78bd1c593220a70ac4987822a0a5862f4c20a54d7ac5d7a03b7964afb"} Jul 14 14:30:00.368445 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.368420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" event={"ID":"5a682348621e758bd4e389d3056fad38","Type":"ContainerStarted","Data":"0e3ecea8e59a41c2349c650678f801f2eee58869fc081d984b3bfaf1fcced489"} Jul 14 14:30:00.369811 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.369790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b8x8z" event={"ID":"f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9","Type":"ContainerStarted","Data":"f6daef3515637fea70b4b87ea1bb9be1b571c9d7318057ecb375f5b339a874f0"} Jul 14 14:30:00.422767 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.422718 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9f2jv" podStartSLOduration=3.077116687 podStartE2EDuration="22.422698513s" totalImagesPullingTime="19.345581826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:00.421199031 +0000 UTC m=+22.728844473" watchObservedRunningTime="2026-07-14 14:30:00.422698513 +0000 UTC m=+22.730343964" Jul 14 14:30:00.423250 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.423215 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lkmv6" podStartSLOduration=3.061629431 podStartE2EDuration="22.423203372s" totalImagesPullingTime="19.361573941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:00.399727848 +0000 UTC m=+22.707373299" watchObservedRunningTime="2026-07-14 14:30:00.423203372 +0000 UTC m=+22.730848823" Jul 14 14:30:00.445745 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.445669 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4tpnl" podStartSLOduration=3.092998508 podStartE2EDuration="22.445657852s" totalImagesPullingTime="19.352659344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:00.445388353 +0000 UTC m=+22.753033803" watchObservedRunningTime="2026-07-14 14:30:00.445657852 +0000 UTC m=+22.753303302" Jul 14 14:30:00.484640 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.484598 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b8x8z" podStartSLOduration=2.830996978 podStartE2EDuration="22.48458232s" totalImagesPullingTime="19.653585342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:00.484290834 +0000 UTC m=+22.791936283" watchObservedRunningTime="2026-07-14 14:30:00.48458232 +0000 UTC m=+22.792227771" Jul 14 14:30:00.545836 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.545789 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-248pl" podStartSLOduration=11.443938598999999 podStartE2EDuration="22.545775337s" totalImagesPullingTime="11.101836738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:00.545719635 +0000 UTC m=+22.853365086" watchObservedRunningTime="2026-07-14 14:30:00.545775337 +0000 UTC m=+22.853420764" Jul 14 14:30:00.546424 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:00.546396 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.ec2.internal" podStartSLOduration=21.546389266 podStartE2EDuration="21.546389266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:00.511151704 +0000 UTC m=+22.818797154" watchObservedRunningTime="2026-07-14 14:30:00.546389266 +0000 UTC m=+22.854034716" Jul 14 14:30:01.220644 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:01.220511 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 14:30:01.373684 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:01.373623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" event={"ID":"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b","Type":"ContainerStarted","Data":"9c4d4fa3562d81b4a826ff4d6a4a9e8cb2f9bbcc4b07afeca6d91c9e636acdd8"} Jul 14 14:30:01.376146 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:01.376128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:30:01.376557 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:01.376539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"6745b8d58bc8d58933a2f981f63593e66d55295a5620a2c977ec02390806095e"} Jul 14 14:30:01.376626 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:01.376615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"dfe56191c94e5e2bad2c6551766ef1bd834f5cdff09384109952f9ff910ccc5d"} Jul 14 14:30:01.377903 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:01.377848 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xfjmb" event={"ID":"b307d70e-2f70-4fed-82be-60927c1595d8","Type":"ContainerStarted","Data":"3ef2dc76139ecfb4398a355c6f2ceff9e4769fb95f636a97414538976b563584"} Jul 14 14:30:02.185875 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.185771 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T14:30:01.220639301Z","UUID":"a72f433f-a04c-4a90-bc17-41f7fbe932fc","Handler":null,"Name":"","Endpoint":""} Jul 14 14:30:02.187373 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.187346 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 14:30:02.187534 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.187388 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 14:30:02.195134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.195109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:02.195134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.195127 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:02.195314 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.195133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:02.195314 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:02.195208 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:02.195314 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:02.195297 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:02.195489 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:02.195367 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:02.774519 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.774481 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-248pl" Jul 14 14:30:02.775160 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.775138 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-248pl" Jul 14 14:30:02.808552 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:02.808438 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xfjmb" podStartSLOduration=5.434471859 podStartE2EDuration="24.808417735s" totalImagesPullingTime="19.373945876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:01.41527083 +0000 UTC m=+23.722916279" watchObservedRunningTime="2026-07-14 14:30:02.808417735 +0000 UTC m=+25.116063184" Jul 14 14:30:03.385659 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:03.385629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:30:03.386065 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:03.386027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"827428adb51880cd7b9847981c5bf5cf573a05296957c7ea46837dc0c4d00b25"} Jul 14 14:30:03.388393 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:03.388366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" event={"ID":"a9a8b98b-5e1b-4634-bbd8-c8a3bf14be9b","Type":"ContainerStarted","Data":"0862ee293637e8fb5f6119beeb705ba850c21d8f42b7bf10cb20b593968a2b42"} Jul 14 14:30:03.388859 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:03.388669 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-248pl" Jul 14 14:30:03.389433 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:03.389413 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-248pl" Jul 14 14:30:03.410073 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:03.410020 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drx7l" podStartSLOduration=2.986055264 podStartE2EDuration="25.410001323s" totalImagesPullingTime="22.423946059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:03.409886821 +0000 UTC m=+25.717532271" watchObservedRunningTime="2026-07-14 14:30:03.410001323 +0000 UTC m=+25.717646771" Jul 14 14:30:04.195366 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:04.195329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:04.196099 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:04.195433 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:04.196099 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:04.195466 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:04.196099 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:04.195543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:04.196099 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:04.195574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:04.196099 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:04.195647 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:06.195482 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.195274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:06.195946 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.195282 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:06.195946 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:06.195581 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:06.195946 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.195291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:06.195946 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:06.195668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:06.195946 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:06.195732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:06.397609 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.397589 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:30:06.397978 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.397959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"3260a2765fae88749e6a74ea91ebcaf7b3cd4abdaab939aa0ddec88eb769df25"} Jul 14 14:30:06.398241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.398218 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:30:06.398372 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.398355 2577 scope.go:117] "RemoveContainer" containerID="5d0606f346bdb0188166ea1383cddef709fa84563abb18c832a26c76cfa58725" Jul 14 14:30:06.400022 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.399999 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc09f6df-0421-414e-b5a6-8e813ee902d0" containerID="6bde6e0549d958bcd7586430a09c9630d433f465298a9066f5a3a088791a9f2f" exitCode=0 Jul 14 14:30:06.400117 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.400035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerDied","Data":"6bde6e0549d958bcd7586430a09c9630d433f465298a9066f5a3a088791a9f2f"} Jul 14 14:30:06.414532 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:06.414515 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:30:07.406888 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.406859 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:30:07.407464 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.407297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" event={"ID":"85a806b8-859e-4313-b082-b9e332805c36","Type":"ContainerStarted","Data":"34b4ee14b5c656d20fb674059e8a086056983aa8009c71c8324b649f781e1408"} Jul 14 14:30:07.407595 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.407577 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:30:07.407673 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.407661 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:30:07.423644 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.423624 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:30:07.501215 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.501160 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" podStartSLOduration=10.071158852 podStartE2EDuration="29.501145047s" totalImagesPullingTime="19.429986195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:07.460158731 +0000 UTC m=+29.767804181" watchObservedRunningTime="2026-07-14 14:30:07.501145047 +0000 UTC m=+29.808790497" Jul 14 14:30:07.919807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.919643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-42nkf"] Jul 14 14:30:07.919913 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.919904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:07.920013 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:07.919995 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:07.930517 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.930494 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qtgq5"] Jul 14 14:30:07.930612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.930598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:07.930705 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:07.930686 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:07.934517 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.934493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vq5qb"] Jul 14 14:30:07.934596 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:07.934569 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:07.934653 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:07.934622 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:08.411411 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:08.411379 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc09f6df-0421-414e-b5a6-8e813ee902d0" containerID="c94e26174dfe05eb1cb202b5d82225430b0142703b549ec7547673abba157e4b" exitCode=0 Jul 14 14:30:08.411854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:08.411487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerDied","Data":"c94e26174dfe05eb1cb202b5d82225430b0142703b549ec7547673abba157e4b"} Jul 14 14:30:09.195568 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:09.195542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:09.195568 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:09.195558 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:09.195778 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:09.195543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:09.195778 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:09.195668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:09.195876 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:09.195799 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:09.195927 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:09.195905 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:10.420396 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:10.420361 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc09f6df-0421-414e-b5a6-8e813ee902d0" containerID="ef389ac43a1edc3f10a678e837f7552472e3a29f70263837bae279b38e175942" exitCode=0 Jul 14 14:30:10.421073 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:10.420414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerDied","Data":"ef389ac43a1edc3f10a678e837f7552472e3a29f70263837bae279b38e175942"} Jul 14 14:30:11.194689 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:11.194657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:11.194854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:11.194657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:11.194854 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.194776 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qtgq5" podUID="f81facd7-e23c-4c7c-aaeb-e38d0accf0c3" Jul 14 14:30:11.194992 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.194866 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42nkf" podUID="799ad4f3-3e43-40aa-87d9-cb11ce14c188" Jul 14 14:30:11.194992 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:11.194658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:11.194992 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.194955 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vq5qb" podUID="4c031eb7-4207-48ce-bf46-ae7303b30d8a" Jul 14 14:30:11.876545 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:11.876513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:11.877027 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.876686 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:30:11.877027 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.876761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret podName:f81facd7-e23c-4c7c-aaeb-e38d0accf0c3 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:43.876741316 +0000 UTC m=+66.184386747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret") pod "global-pull-secret-syncer-qtgq5" (UID: "f81facd7-e23c-4c7c-aaeb-e38d0accf0c3") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:30:11.976834 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:11.976806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:11.977011 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:11.976859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:11.977011 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.976967 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:30:11.977011 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.976978 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:30:11.977011 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.977005 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:30:11.977155 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.977020 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hrxz2 for pod openshift-network-diagnostics/network-check-target-vq5qb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:30:11.977155 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.977026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:43.97700572 +0000 UTC m=+66.284651166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:30:11.977155 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:11.977060 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2 podName:4c031eb7-4207-48ce-bf46-ae7303b30d8a nodeName:}" failed. No retries permitted until 2026-07-14 14:30:43.977047349 +0000 UTC m=+66.284692781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrxz2" (UniqueName: "kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2") pod "network-check-target-vq5qb" (UID: "4c031eb7-4207-48ce-bf46-ae7303b30d8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:30:13.022879 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.022712 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-71.ec2.internal" event="NodeReady" Jul 14 14:30:13.023261 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.022983 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 14:30:13.059850 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.059823 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c54c48fb8-pplvc"] Jul 14 14:30:13.064802 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.064780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.068968 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.068945 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 14:30:13.069098 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.068976 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 14:30:13.069098 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.069001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 14:30:13.069446 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.069429 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f7csw\"" Jul 14 14:30:13.078184 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.078166 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 14:30:13.078834 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.078671 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c54c48fb8-pplvc"] Jul 14 14:30:13.081719 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.081699 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jwmh9"] Jul 14 14:30:13.085224 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.085199 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lfzpd"] Jul 14 14:30:13.085337 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.085318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.087761 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.087719 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 14:30:13.087761 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.087743 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 14:30:13.087899 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.087795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9k9pr\"" Jul 14 14:30:13.088338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.088322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.091316 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.091301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 14:30:13.091840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.091613 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 14:30:13.091840 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.091677 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x6l7x\"" Jul 14 14:30:13.093157 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.093141 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 14:30:13.097899 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.097224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwmh9"] Jul 14 14:30:13.098223 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.098138 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfzpd"] Jul 14 14:30:13.185108 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-installation-pull-secrets\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.185270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-bound-sa-token\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.185270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxtxf\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-kube-api-access-qxtxf\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.185270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/087142ff-5423-41d4-b1f6-1df250d0e444-cert\") pod \"ingress-canary-lfzpd\" (UID: \"087142ff-5423-41d4-b1f6-1df250d0e444\") " pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.185270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m57pv\" (UniqueName: \"kubernetes.io/projected/087142ff-5423-41d4-b1f6-1df250d0e444-kube-api-access-m57pv\") pod \"ingress-canary-lfzpd\" (UID: \"087142ff-5423-41d4-b1f6-1df250d0e444\") " pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkpqk\" (UniqueName: \"kubernetes.io/projected/d8ce8931-520a-422e-ab09-8599f1ca6f1b-kube-api-access-gkpqk\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-trusted-ca\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ce8931-520a-422e-ab09-8599f1ca6f1b-config-volume\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ce8931-520a-422e-ab09-8599f1ca6f1b-tmp-dir\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-image-registry-private-configuration\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24bce890-d4d6-4a0a-a418-340cb3b492e9-ca-trust-extracted\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.186036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.185546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-certificates\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.195312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.195285 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:13.195312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.195307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:13.195495 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.195290 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:13.197872 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.197851 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 14:30:13.197984 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.197872 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 14:30:13.197984 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.197881 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kh92q\"" Jul 14 14:30:13.197984 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.197876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 14:30:13.197984 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.197967 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7rw9n\"" Jul 14 14:30:13.198197 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.197990 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 14:30:13.286744 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-installation-pull-secrets\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.286744 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-bound-sa-token\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.286744 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxtxf\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-kube-api-access-qxtxf\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.286744 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/087142ff-5423-41d4-b1f6-1df250d0e444-cert\") pod \"ingress-canary-lfzpd\" (UID: \"087142ff-5423-41d4-b1f6-1df250d0e444\") " pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m57pv\" (UniqueName: \"kubernetes.io/projected/087142ff-5423-41d4-b1f6-1df250d0e444-kube-api-access-m57pv\") pod \"ingress-canary-lfzpd\" (UID: \"087142ff-5423-41d4-b1f6-1df250d0e444\") " pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkpqk\" (UniqueName: \"kubernetes.io/projected/d8ce8931-520a-422e-ab09-8599f1ca6f1b-kube-api-access-gkpqk\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-trusted-ca\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ce8931-520a-422e-ab09-8599f1ca6f1b-config-volume\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ce8931-520a-422e-ab09-8599f1ca6f1b-tmp-dir\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-image-registry-private-configuration\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.286994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24bce890-d4d6-4a0a-a418-340cb3b492e9-ca-trust-extracted\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.287344 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.286999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-certificates\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.287790 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.287405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8ce8931-520a-422e-ab09-8599f1ca6f1b-tmp-dir\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.287790 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.287666 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-certificates\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.287790 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.287716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24bce890-d4d6-4a0a-a418-340cb3b492e9-ca-trust-extracted\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.287790 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.287761 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:13.288054 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.287831 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:30:13.787813091 +0000 UTC m=+36.095458535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:13.288054 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.287883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8ce8931-520a-422e-ab09-8599f1ca6f1b-config-volume\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.288054 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.287765 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:13.288054 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.287921 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:13.288054 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.287964 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-trusted-ca\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.288054 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.287978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:13.787961822 +0000 UTC m=+36.095607253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:13.291542 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.291505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/087142ff-5423-41d4-b1f6-1df250d0e444-cert\") pod \"ingress-canary-lfzpd\" (UID: \"087142ff-5423-41d4-b1f6-1df250d0e444\") " pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.291542 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.291531 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-image-registry-private-configuration\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.291681 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.291530 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-installation-pull-secrets\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.296361 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.296317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m57pv\" (UniqueName: \"kubernetes.io/projected/087142ff-5423-41d4-b1f6-1df250d0e444-kube-api-access-m57pv\") pod \"ingress-canary-lfzpd\" (UID: \"087142ff-5423-41d4-b1f6-1df250d0e444\") " pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.296911 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.296884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkpqk\" (UniqueName: \"kubernetes.io/projected/d8ce8931-520a-422e-ab09-8599f1ca6f1b-kube-api-access-gkpqk\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.297018 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.296965 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxtxf\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-kube-api-access-qxtxf\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.297640 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.297620 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-bound-sa-token\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.402490 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.402467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfzpd" Jul 14 14:30:13.789512 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.789466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:13.789690 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.789604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:13.789690 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.789635 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:13.789690 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.789658 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:13.789880 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.789707 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:13.789880 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.789741 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:14.789718776 +0000 UTC m=+37.097364227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:13.789880 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:13.789767 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:30:14.789751076 +0000 UTC m=+37.097396520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:13.968798 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:13.968762 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:14.571184 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:14.571160 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfzpd"] Jul 14 14:30:14.574597 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:14.574569 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087142ff_5423_41d4_b1f6_1df250d0e444.slice/crio-503bfb74f7fb9460acfcadd9dc938d30fede64112fa4ddde28ddea755ef246be WatchSource:0}: Error finding container 503bfb74f7fb9460acfcadd9dc938d30fede64112fa4ddde28ddea755ef246be: Status 404 returned error can't find the container with id 503bfb74f7fb9460acfcadd9dc938d30fede64112fa4ddde28ddea755ef246be Jul 14 14:30:14.798074 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:14.798011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:14.798074 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:14.798045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:14.798223 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:14.798162 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:14.798223 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:14.798172 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:14.798223 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:14.798169 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:14.798327 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:14.798230 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:16.798217797 +0000 UTC m=+39.105863225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:14.798327 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:14.798241 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:30:16.798235787 +0000 UTC m=+39.105881215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:15.434402 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:15.434152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfzpd" event={"ID":"087142ff-5423-41d4-b1f6-1df250d0e444","Type":"ContainerStarted","Data":"503bfb74f7fb9460acfcadd9dc938d30fede64112fa4ddde28ddea755ef246be"} Jul 14 14:30:15.439318 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:15.439291 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc09f6df-0421-414e-b5a6-8e813ee902d0" containerID="e5584954e71da24e93a1c68e78de8d81fa142f13660d60582ea214c55386068f" exitCode=0 Jul 14 14:30:15.439318 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:15.439325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerDied","Data":"e5584954e71da24e93a1c68e78de8d81fa142f13660d60582ea214c55386068f"} Jul 14 14:30:16.446009 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:16.445972 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc09f6df-0421-414e-b5a6-8e813ee902d0" containerID="480f20b64df5ffc234b6b1c15db5dfac001b5924e4084790f610871656327905" exitCode=0 Jul 14 14:30:16.446499 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:16.446056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerDied","Data":"480f20b64df5ffc234b6b1c15db5dfac001b5924e4084790f610871656327905"} Jul 14 14:30:16.722976 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:16.722906 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:16.813035 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:16.813010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:16.813127 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:16.813052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:16.813182 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:16.813154 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:16.813225 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:16.813203 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:16.813225 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:16.813218 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:16.813311 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:16.813208 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:30:20.813194183 +0000 UTC m=+43.120839612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:16.813311 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:16.813275 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:20.813258737 +0000 UTC m=+43.120904164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:17.451994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:17.451959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" event={"ID":"fc09f6df-0421-414e-b5a6-8e813ee902d0","Type":"ContainerStarted","Data":"0d96476898c0651eb500b6318ee33f856dc0e7b336080137182ce8574b8dae29"} Jul 14 14:30:17.453390 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:17.453357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfzpd" event={"ID":"087142ff-5423-41d4-b1f6-1df250d0e444","Type":"ContainerStarted","Data":"e2935efcb1d1c8c951d92aa3cee672952213a6b72cd844e9be447d73c3afcae2"} Jul 14 14:30:17.476343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:17.476285 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vwnw8" podStartSLOduration=8.220733329 podStartE2EDuration="39.476272475s" totalImagesPullingTime="31.255539146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:17.474819314 +0000 UTC m=+39.782464767" watchObservedRunningTime="2026-07-14 14:30:17.476272475 +0000 UTC m=+39.783917925" Jul 14 14:30:17.491775 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:17.491739 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lfzpd" podStartSLOduration=1.954689608 podStartE2EDuration="4.491725654s" totalImagesPullingTime="2.537036046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:17.490683309 +0000 UTC m=+39.798328759" watchObservedRunningTime="2026-07-14 14:30:17.491725654 +0000 UTC m=+39.799371081" Jul 14 14:30:17.605270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:17.605221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:17.682438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:17.682404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:20.840957 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:20.840924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:20.840957 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:20.840954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:20.841328 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:20.841054 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:20.841328 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:20.841070 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:20.841328 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:20.841110 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:28.841096972 +0000 UTC m=+51.148742400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:20.841328 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:20.841054 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:20.841328 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:20.841190 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:30:28.841177312 +0000 UTC m=+51.148822739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:22.313219 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:22.313160 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:22.388970 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:22.388934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:24.428958 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:24.428927 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:24.500198 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:24.500151 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:28.892475 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:28.892430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:28.892828 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:28.892488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:28.892828 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:28.892582 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:28.892828 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:28.892641 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:30:44.892627451 +0000 UTC m=+67.200272881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:28.892828 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:28.892648 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:28.892828 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:28.892665 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:28.892828 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:28.892723 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:44.892705713 +0000 UTC m=+67.200351162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:36.032631 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:36.032591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:36.131968 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:36.131942 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:38.112351 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:38.112322 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:38.179992 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:38.179962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:39.032752 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:39.032714 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:39.427536 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:39.427508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qq9kk" Jul 14 14:30:39.581819 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:39.581796 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:39.779987 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:39.779909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:43.897835 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:43.897805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:43.900395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:43.900375 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 14:30:43.911728 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:43.911693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f81facd7-e23c-4c7c-aaeb-e38d0accf0c3-original-pull-secret\") pod \"global-pull-secret-syncer-qtgq5\" (UID: \"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3\") " pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:43.998733 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:43.998701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:43.998853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:43.998751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:30:44.001217 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.001194 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 14:30:44.001270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.001223 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 14:30:44.009160 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.009142 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 14:30:44.009209 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.009194 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs podName:799ad4f3-3e43-40aa-87d9-cb11ce14c188 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:48.009179045 +0000 UTC m=+130.316824476 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs") pod "network-metrics-daemon-42nkf" (UID: "799ad4f3-3e43-40aa-87d9-cb11ce14c188") : secret "metrics-daemon-secret" not found Jul 14 14:30:44.011397 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.011382 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 14:30:44.021922 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.021901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrxz2\" (UniqueName: \"kubernetes.io/projected/4c031eb7-4207-48ce-bf46-ae7303b30d8a-kube-api-access-hrxz2\") pod \"network-check-target-vq5qb\" (UID: \"4c031eb7-4207-48ce-bf46-ae7303b30d8a\") " pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:44.115296 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.115273 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kh92q\"" Jul 14 14:30:44.118138 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.118124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qtgq5" Jul 14 14:30:44.123162 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.123146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:44.242870 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.242845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qtgq5"] Jul 14 14:30:44.245700 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:44.245668 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81facd7_e23c_4c7c_aaeb_e38d0accf0c3.slice/crio-640370216faf9ab91e4019427ab12507d15ebe355846ae65a2df3a0284744d82 WatchSource:0}: Error finding container 640370216faf9ab91e4019427ab12507d15ebe355846ae65a2df3a0284744d82: Status 404 returned error can't find the container with id 640370216faf9ab91e4019427ab12507d15ebe355846ae65a2df3a0284744d82 Jul 14 14:30:44.257973 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.257932 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vq5qb"] Jul 14 14:30:44.261115 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:44.261096 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c031eb7_4207_48ce_bf46_ae7303b30d8a.slice/crio-da6c854d55207d3be998934b1ff81c542cde3e2da485128190e09b8a191874ea WatchSource:0}: Error finding container da6c854d55207d3be998934b1ff81c542cde3e2da485128190e09b8a191874ea: Status 404 returned error can't find the container with id da6c854d55207d3be998934b1ff81c542cde3e2da485128190e09b8a191874ea Jul 14 14:30:44.512192 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.512162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qtgq5" event={"ID":"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3","Type":"ContainerStarted","Data":"640370216faf9ab91e4019427ab12507d15ebe355846ae65a2df3a0284744d82"} Jul 14 14:30:44.513250 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.513216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vq5qb" event={"ID":"4c031eb7-4207-48ce-bf46-ae7303b30d8a","Type":"ContainerStarted","Data":"da6c854d55207d3be998934b1ff81c542cde3e2da485128190e09b8a191874ea"} Jul 14 14:30:44.906379 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.906300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:30:44.906379 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:44.906344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:30:44.906863 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.906449 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 14:30:44.906863 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.906473 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:30:44.906863 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.906478 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c54c48fb8-pplvc: secret "image-registry-tls" not found Jul 14 14:30:44.906863 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.906568 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls podName:d8ce8931-520a-422e-ab09-8599f1ca6f1b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:16.906544884 +0000 UTC m=+99.214190316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls") pod "dns-default-jwmh9" (UID: "d8ce8931-520a-422e-ab09-8599f1ca6f1b") : secret "dns-default-metrics-tls" not found Jul 14 14:30:44.906863 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:44.906628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls podName:24bce890-d4d6-4a0a-a418-340cb3b492e9 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:16.906616396 +0000 UTC m=+99.214261823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls") pod "image-registry-7c54c48fb8-pplvc" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9") : secret "image-registry-tls" not found Jul 14 14:30:46.572403 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:46.572367 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:46.672355 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:46.672322 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:46.739499 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:46.739465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:47.633477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:47.633409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:47.755008 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:47.754980 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:49.511766 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.511737 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:49.528005 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.527984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vq5qb" event={"ID":"4c031eb7-4207-48ce-bf46-ae7303b30d8a","Type":"ContainerStarted","Data":"b9f2c6c07de0efa53f20f9e89240e778dd91d394807698f211fc66469684529c"} Jul 14 14:30:49.528148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.528047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:30:49.529400 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.529380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qtgq5" event={"ID":"f81facd7-e23c-4c7c-aaeb-e38d0accf0c3","Type":"ContainerStarted","Data":"b4fad55bf4b4446518b3f6f3c2798377787cc5a4038578c86b05e19fb2a3f775"} Jul 14 14:30:49.565267 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.565225 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vq5qb" podStartSLOduration=66.67437822 podStartE2EDuration="1m11.565213572s" totalImagesPullingTime="4.890835352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:49.544259382 +0000 UTC m=+71.851904832" watchObservedRunningTime="2026-07-14 14:30:49.565213572 +0000 UTC m=+71.872859024" Jul 14 14:30:49.565523 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.565494 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qtgq5" podStartSLOduration=66.654615756 podStartE2EDuration="1m11.565489174s" totalImagesPullingTime="4.910873418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:49.564198117 +0000 UTC m=+71.871843567" watchObservedRunningTime="2026-07-14 14:30:49.565489174 +0000 UTC m=+71.873134624" Jul 14 14:30:49.989003 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:49.988969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:50.027196 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.027170 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4"] Jul 14 14:30:50.030013 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.029999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" Jul 14 14:30:50.032660 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.032633 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:30:50.032745 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.032633 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 14:30:50.032745 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.032638 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tkbcv\"" Jul 14 14:30:50.043197 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.043174 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4"] Jul 14 14:30:50.091731 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.091701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:50.141568 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.141544 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4"] Jul 14 14:30:50.145110 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.145089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89gl\" (UniqueName: \"kubernetes.io/projected/af720145-9696-4937-b39d-1be4220e68a9-kube-api-access-r89gl\") pod \"volume-data-source-validator-78495597f6-tgbv4\" (UID: \"af720145-9696-4937-b39d-1be4220e68a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" Jul 14 14:30:50.147627 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.147609 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7"] Jul 14 14:30:50.147748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.147731 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.150176 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150158 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6"] Jul 14 14:30:50.150285 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150191 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 14:30:50.150285 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150221 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 14:30:50.150400 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.150606 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150286 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 14:30:50.150832 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150812 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:30:50.150894 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.150831 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tx4kw\"" Jul 14 14:30:50.152886 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.152868 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv"] Jul 14 14:30:50.152982 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.152963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" Jul 14 14:30:50.153186 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.153167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 14:30:50.153247 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.153226 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 14:30:50.155715 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.155697 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz"] Jul 14 14:30:50.155815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.155802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.155871 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.155845 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 14:30:50.155948 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.155930 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 14:30:50.156174 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.156157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4ddpd\"" Jul 14 14:30:50.156707 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.156691 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z65m7\"" Jul 14 14:30:50.157862 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.157848 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:30:50.158129 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.158117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6wgbh\"" Jul 14 14:30:50.158245 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.158233 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 14:30:50.158430 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.158412 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 14:30:50.158559 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.158543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.161739 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.161718 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 14:30:50.162240 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.161968 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 14:30:50.162240 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.162123 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 14:30:50.162240 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.162152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s6v8n\"" Jul 14 14:30:50.162713 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.162526 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:30:50.163029 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.163009 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4"] Jul 14 14:30:50.163711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.163691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7"] Jul 14 14:30:50.167675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.167629 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz"] Jul 14 14:30:50.168864 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.168844 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv"] Jul 14 14:30:50.169672 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.169651 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6"] Jul 14 14:30:50.245369 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/958e7bf7-ea76-4975-b164-37e36e83cc82-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.245369 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcs8b\" (UniqueName: \"kubernetes.io/projected/3c3a9671-6e84-4d06-9771-e99047ade8b1-kube-api-access-qcs8b\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.245546 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzssn\" (UniqueName: \"kubernetes.io/projected/6406a951-eecf-4c6e-98fd-98e5b434f4cf-kube-api-access-wzssn\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.245546 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q92cl\" (UniqueName: \"kubernetes.io/projected/38f215a5-d203-4cbb-9d9f-9c64b40ba381-kube-api-access-q92cl\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.245546 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958e7bf7-ea76-4975-b164-37e36e83cc82-config\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.245546 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88pr\" (UniqueName: \"kubernetes.io/projected/958e7bf7-ea76-4975-b164-37e36e83cc82-kube-api-access-p88pr\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.245699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6406a951-eecf-4c6e-98fd-98e5b434f4cf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.245699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.245699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38f215a5-d203-4cbb-9d9f-9c64b40ba381-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.245699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89gl\" (UniqueName: \"kubernetes.io/projected/af720145-9696-4937-b39d-1be4220e68a9-kube-api-access-r89gl\") pod \"volume-data-source-validator-78495597f6-tgbv4\" (UID: \"af720145-9696-4937-b39d-1be4220e68a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" Jul 14 14:30:50.245877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.245877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmnw7\" (UniqueName: \"kubernetes.io/projected/6da94a90-c87c-4364-8062-bcf6ab75029d-kube-api-access-qmnw7\") pod \"network-check-source-869dcfcdcd-cbjk6\" (UID: \"6da94a90-c87c-4364-8062-bcf6ab75029d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" Jul 14 14:30:50.245877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.245797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6406a951-eecf-4c6e-98fd-98e5b434f4cf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.252317 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.252293 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:50.254543 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.254524 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89gl\" (UniqueName: \"kubernetes.io/projected/af720145-9696-4937-b39d-1be4220e68a9-kube-api-access-r89gl\") pod \"volume-data-source-validator-78495597f6-tgbv4\" (UID: \"af720145-9696-4937-b39d-1be4220e68a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" Jul 14 14:30:50.323554 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.323529 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:50.338600 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.338584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" Jul 14 14:30:50.346533 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.346629 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmnw7\" (UniqueName: \"kubernetes.io/projected/6da94a90-c87c-4364-8062-bcf6ab75029d-kube-api-access-qmnw7\") pod \"network-check-source-869dcfcdcd-cbjk6\" (UID: \"6da94a90-c87c-4364-8062-bcf6ab75029d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" Jul 14 14:30:50.346629 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6406a951-eecf-4c6e-98fd-98e5b434f4cf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.346629 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/958e7bf7-ea76-4975-b164-37e36e83cc82-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcs8b\" (UniqueName: \"kubernetes.io/projected/3c3a9671-6e84-4d06-9771-e99047ade8b1-kube-api-access-qcs8b\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.346639 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzssn\" (UniqueName: \"kubernetes.io/projected/6406a951-eecf-4c6e-98fd-98e5b434f4cf-kube-api-access-wzssn\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q92cl\" (UniqueName: \"kubernetes.io/projected/38f215a5-d203-4cbb-9d9f-9c64b40ba381-kube-api-access-q92cl\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.346696 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls podName:38f215a5-d203-4cbb-9d9f-9c64b40ba381 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:50.846678307 +0000 UTC m=+73.154323735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hmn7" (UID: "38f215a5-d203-4cbb-9d9f-9c64b40ba381") : secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958e7bf7-ea76-4975-b164-37e36e83cc82-config\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p88pr\" (UniqueName: \"kubernetes.io/projected/958e7bf7-ea76-4975-b164-37e36e83cc82-kube-api-access-p88pr\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.346807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6406a951-eecf-4c6e-98fd-98e5b434f4cf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.347207 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.347207 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.346851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38f215a5-d203-4cbb-9d9f-9c64b40ba381-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.347207 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.347123 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:30:50.347207 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.347192 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls podName:3c3a9671-6e84-4d06-9771-e99047ade8b1 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:50.847176004 +0000 UTC m=+73.154821443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls") pod "cluster-samples-operator-65db858894-cxxbv" (UID: "3c3a9671-6e84-4d06-9771-e99047ade8b1") : secret "samples-operator-tls" not found Jul 14 14:30:50.347406 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.347346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958e7bf7-ea76-4975-b164-37e36e83cc82-config\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.347592 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.347573 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38f215a5-d203-4cbb-9d9f-9c64b40ba381-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.347592 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.347564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6406a951-eecf-4c6e-98fd-98e5b434f4cf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.349183 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.349164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/958e7bf7-ea76-4975-b164-37e36e83cc82-serving-cert\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.349404 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.349371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6406a951-eecf-4c6e-98fd-98e5b434f4cf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.358684 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.358664 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcs8b\" (UniqueName: \"kubernetes.io/projected/3c3a9671-6e84-4d06-9771-e99047ade8b1-kube-api-access-qcs8b\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.361000 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.360972 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzssn\" (UniqueName: \"kubernetes.io/projected/6406a951-eecf-4c6e-98fd-98e5b434f4cf-kube-api-access-wzssn\") pod \"kube-storage-version-migrator-operator-799cb7f958-bn2gz\" (UID: \"6406a951-eecf-4c6e-98fd-98e5b434f4cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.361646 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.361624 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q92cl\" (UniqueName: \"kubernetes.io/projected/38f215a5-d203-4cbb-9d9f-9c64b40ba381-kube-api-access-q92cl\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.362090 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.362072 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmnw7\" (UniqueName: \"kubernetes.io/projected/6da94a90-c87c-4364-8062-bcf6ab75029d-kube-api-access-qmnw7\") pod \"network-check-source-869dcfcdcd-cbjk6\" (UID: \"6da94a90-c87c-4364-8062-bcf6ab75029d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" Jul 14 14:30:50.362346 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.362327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88pr\" (UniqueName: \"kubernetes.io/projected/958e7bf7-ea76-4975-b164-37e36e83cc82-kube-api-access-p88pr\") pod \"service-ca-operator-7695fc6c8c-nnnb4\" (UID: \"958e7bf7-ea76-4975-b164-37e36e83cc82\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.455471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.455431 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4"] Jul 14 14:30:50.457483 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.457441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" Jul 14 14:30:50.458448 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:50.458426 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf720145_9696_4937_b39d_1be4220e68a9.slice/crio-8e044292b98de6092e8d9c0d8d5d20104f0ba08514d18919eb6d6816a68c8569 WatchSource:0}: Error finding container 8e044292b98de6092e8d9c0d8d5d20104f0ba08514d18919eb6d6816a68c8569: Status 404 returned error can't find the container with id 8e044292b98de6092e8d9c0d8d5d20104f0ba08514d18919eb6d6816a68c8569 Jul 14 14:30:50.471729 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.471701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" Jul 14 14:30:50.482687 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.482665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" Jul 14 14:30:50.535815 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.535773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" event={"ID":"af720145-9696-4937-b39d-1be4220e68a9","Type":"ContainerStarted","Data":"8e044292b98de6092e8d9c0d8d5d20104f0ba08514d18919eb6d6816a68c8569"} Jul 14 14:30:50.597497 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.597288 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4"] Jul 14 14:30:50.601122 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:50.601091 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958e7bf7_ea76_4975_b164_37e36e83cc82.slice/crio-7b050948829171bf140db2bda07bd48a5a00ecdfa290d534ce48b158b6bef975 WatchSource:0}: Error finding container 7b050948829171bf140db2bda07bd48a5a00ecdfa290d534ce48b158b6bef975: Status 404 returned error can't find the container with id 7b050948829171bf140db2bda07bd48a5a00ecdfa290d534ce48b158b6bef975 Jul 14 14:30:50.611536 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.611512 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6"] Jul 14 14:30:50.614250 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:50.614214 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da94a90_c87c_4364_8062_bcf6ab75029d.slice/crio-c1b43edd4ce33edcae788de2cbd6da601bf9b672bc0f32e170383ba87ec54f75 WatchSource:0}: Error finding container c1b43edd4ce33edcae788de2cbd6da601bf9b672bc0f32e170383ba87ec54f75: Status 404 returned error can't find the container with id c1b43edd4ce33edcae788de2cbd6da601bf9b672bc0f32e170383ba87ec54f75 Jul 14 14:30:50.635422 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.635398 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz"] Jul 14 14:30:50.656371 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:50.656345 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6406a951_eecf_4c6e_98fd_98e5b434f4cf.slice/crio-e4a748f8b6214c54e83920a04269227169b511c4deedf6d215bda7fff0044d6e WatchSource:0}: Error finding container e4a748f8b6214c54e83920a04269227169b511c4deedf6d215bda7fff0044d6e: Status 404 returned error can't find the container with id e4a748f8b6214c54e83920a04269227169b511c4deedf6d215bda7fff0044d6e Jul 14 14:30:50.851687 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.851627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:50.851807 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.851785 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:50.851860 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:50.851798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:50.851860 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.851855 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls podName:38f215a5-d203-4cbb-9d9f-9c64b40ba381 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:51.851836504 +0000 UTC m=+74.159481933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hmn7" (UID: "38f215a5-d203-4cbb-9d9f-9c64b40ba381") : secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:50.851935 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.851909 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:30:50.851967 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:50.851948 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls podName:3c3a9671-6e84-4d06-9771-e99047ade8b1 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:51.851936394 +0000 UTC m=+74.159581832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls") pod "cluster-samples-operator-65db858894-cxxbv" (UID: "3c3a9671-6e84-4d06-9771-e99047ade8b1") : secret "samples-operator-tls" not found Jul 14 14:30:51.539845 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.539804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" event={"ID":"6da94a90-c87c-4364-8062-bcf6ab75029d","Type":"ContainerStarted","Data":"6a96404782e0fe1d2bd852c5ac728cb97bc89c7294586e8cb0130bc1ae8c8045"} Jul 14 14:30:51.540280 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.539894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" event={"ID":"6da94a90-c87c-4364-8062-bcf6ab75029d","Type":"ContainerStarted","Data":"c1b43edd4ce33edcae788de2cbd6da601bf9b672bc0f32e170383ba87ec54f75"} Jul 14 14:30:51.540967 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.540945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" event={"ID":"958e7bf7-ea76-4975-b164-37e36e83cc82","Type":"ContainerStarted","Data":"7b050948829171bf140db2bda07bd48a5a00ecdfa290d534ce48b158b6bef975"} Jul 14 14:30:51.542081 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.542044 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" event={"ID":"6406a951-eecf-4c6e-98fd-98e5b434f4cf","Type":"ContainerStarted","Data":"e4a748f8b6214c54e83920a04269227169b511c4deedf6d215bda7fff0044d6e"} Jul 14 14:30:51.555985 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.555938 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cbjk6" podStartSLOduration=1.55592639 podStartE2EDuration="1.55592639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:51.555424805 +0000 UTC m=+73.863070269" watchObservedRunningTime="2026-07-14 14:30:51.55592639 +0000 UTC m=+73.863571839" Jul 14 14:30:51.859511 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.859412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:51.859511 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:51.859496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:51.859818 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:51.859594 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:30:51.859818 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:51.859620 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:51.859818 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:51.859671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls podName:3c3a9671-6e84-4d06-9771-e99047ade8b1 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:53.859650821 +0000 UTC m=+76.167296258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls") pod "cluster-samples-operator-65db858894-cxxbv" (UID: "3c3a9671-6e84-4d06-9771-e99047ade8b1") : secret "samples-operator-tls" not found Jul 14 14:30:51.859818 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:51.859692 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls podName:38f215a5-d203-4cbb-9d9f-9c64b40ba381 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:53.859681889 +0000 UTC m=+76.167327324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hmn7" (UID: "38f215a5-d203-4cbb-9d9f-9c64b40ba381") : secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:52.548400 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:52.548362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" event={"ID":"af720145-9696-4937-b39d-1be4220e68a9","Type":"ContainerStarted","Data":"7c3efbef2a6ad46652bd7ecc1fc57e77035414f2dc015d9f927d645e43bd0ae0"} Jul 14 14:30:52.569256 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:52.569202 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tgbv4" podStartSLOduration=1.002162338 podStartE2EDuration="2.569187795s" totalImagesPullingTime="1.567025457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:52.568603407 +0000 UTC m=+74.876248858" watchObservedRunningTime="2026-07-14 14:30:52.569187795 +0000 UTC m=+74.876833245" Jul 14 14:30:52.901646 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:52.901565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:52.990419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:52.990345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:53.293328 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:53.293295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:53.395334 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:53.395297 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:53.493377 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:53.493333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:53.875489 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:53.875393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:53.875928 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:53.875522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:53.875928 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:53.875569 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:53.875928 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:53.875643 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls podName:38f215a5-d203-4cbb-9d9f-9c64b40ba381 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:57.875621778 +0000 UTC m=+80.183267206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hmn7" (UID: "38f215a5-d203-4cbb-9d9f-9c64b40ba381") : secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:53.875928 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:53.875645 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:30:53.875928 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:53.875684 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls podName:3c3a9671-6e84-4d06-9771-e99047ade8b1 nodeName:}" failed. No retries permitted until 2026-07-14 14:30:57.875675053 +0000 UTC m=+80.183320482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls") pod "cluster-samples-operator-65db858894-cxxbv" (UID: "3c3a9671-6e84-4d06-9771-e99047ade8b1") : secret "samples-operator-tls" not found Jul 14 14:30:54.411727 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:54.411699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:54.470444 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:54.470413 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:54.560504 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:54.560429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" event={"ID":"6406a951-eecf-4c6e-98fd-98e5b434f4cf","Type":"ContainerStarted","Data":"4186ad1e950683982d66750b5b955946031775b6788c8790aa3bdce7912c1098"} Jul 14 14:30:54.561984 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:54.561962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" event={"ID":"958e7bf7-ea76-4975-b164-37e36e83cc82","Type":"ContainerStarted","Data":"600479173a91e7811943e168c117cc1305805952f8062bd3a363d5546aa95bed"} Jul 14 14:30:54.576386 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:54.576344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" podStartSLOduration=1.731827042 podStartE2EDuration="4.576330386s" totalImagesPullingTime="2.844503344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:54.575682495 +0000 UTC m=+76.883327947" watchObservedRunningTime="2026-07-14 14:30:54.576330386 +0000 UTC m=+76.883975836" Jul 14 14:30:54.591816 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:54.591752 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" podStartSLOduration=0.926855747 podStartE2EDuration="4.591727233s" totalImagesPullingTime="3.664871486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:54.591646814 +0000 UTC m=+76.899292262" watchObservedRunningTime="2026-07-14 14:30:54.591727233 +0000 UTC m=+76.899372684" Jul 14 14:30:55.230655 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.230622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:55.331101 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.331070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:55.795991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.795940 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:55.857190 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.857141 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:55.968514 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.968483 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lrl8m"] Jul 14 14:30:55.971671 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.971651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:55.974556 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.974536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 14:30:55.974676 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.974536 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 14:30:55.974676 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.974575 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 14:30:55.974676 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.974578 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zn4rf\"" Jul 14 14:30:55.975491 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.975470 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 14:30:55.990223 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:55.990203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrl8m"] Jul 14 14:30:56.016569 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.016539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:56.080321 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.080268 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:56.091354 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.091338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5r55\" (UniqueName: \"kubernetes.io/projected/386db8ca-8205-49d6-8998-099cc656148c-kube-api-access-t5r55\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.091424 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.091373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.091470 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.091435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.091509 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.091483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/386db8ca-8205-49d6-8998-099cc656148c-crio-socket\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.091509 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.091500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/386db8ca-8205-49d6-8998-099cc656148c-data-volume\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192493 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5r55\" (UniqueName: \"kubernetes.io/projected/386db8ca-8205-49d6-8998-099cc656148c-kube-api-access-t5r55\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192580 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192633 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192633 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/386db8ca-8205-49d6-8998-099cc656148c-crio-socket\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192745 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/386db8ca-8205-49d6-8998-099cc656148c-data-volume\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192745 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.192647 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:30:56.192745 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192730 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/386db8ca-8205-49d6-8998-099cc656148c-crio-socket\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.192872 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.192706 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:30:56.192872 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.192778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:30:56.692759824 +0000 UTC m=+79.000405254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : configmap "kube-rbac-proxy" not found Jul 14 14:30:56.192872 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.192798 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:30:56.692784923 +0000 UTC m=+79.000430355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : secret "insights-runtime-extractor-tls" not found Jul 14 14:30:56.193024 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.192980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/386db8ca-8205-49d6-8998-099cc656148c-data-volume\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.201939 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.201921 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5r55\" (UniqueName: \"kubernetes.io/projected/386db8ca-8205-49d6-8998-099cc656148c-kube-api-access-t5r55\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.489741 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.489707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:56.586032 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.586004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:56.696111 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.696088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.696204 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:56.696144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:56.696239 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.696203 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:30:56.696271 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.696263 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:30:57.696246934 +0000 UTC m=+80.003892374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : configmap "kube-rbac-proxy" not found Jul 14 14:30:56.696348 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.696292 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:30:56.696348 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:56.696336 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:30:57.696323738 +0000 UTC m=+80.003969167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : secret "insights-runtime-extractor-tls" not found Jul 14 14:30:57.703420 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:57.703388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:57.703811 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:57.703439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:57.703811 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.703515 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:30:57.703811 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.703539 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:30:57.703811 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.703572 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:30:59.703557714 +0000 UTC m=+82.011203141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : configmap "kube-rbac-proxy" not found Jul 14 14:30:57.703811 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.703586 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:30:59.703579743 +0000 UTC m=+82.011225170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : secret "insights-runtime-extractor-tls" not found Jul 14 14:30:57.904733 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:57.904705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:30:57.904869 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:57.904752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:30:57.904869 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.904832 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:57.904869 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.904834 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:30:57.904997 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.904876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls podName:38f215a5-d203-4cbb-9d9f-9c64b40ba381 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:05.90486334 +0000 UTC m=+88.212508767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hmn7" (UID: "38f215a5-d203-4cbb-9d9f-9c64b40ba381") : secret "cluster-monitoring-operator-tls" not found Jul 14 14:30:57.904997 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:57.904888 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls podName:3c3a9671-6e84-4d06-9771-e99047ade8b1 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:05.904882041 +0000 UTC m=+88.212527468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls") pod "cluster-samples-operator-65db858894-cxxbv" (UID: "3c3a9671-6e84-4d06-9771-e99047ade8b1") : secret "samples-operator-tls" not found Jul 14 14:30:58.086334 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.086269 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wz5bl"] Jul 14 14:30:58.089463 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.089433 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.091971 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.091940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 14:30:58.092305 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.092288 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 14:30:58.093019 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.092999 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 14:30:58.093109 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.093050 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 14:30:58.093188 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.093104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7bwnw\"" Jul 14 14:30:58.099851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.099826 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wz5bl"] Jul 14 14:30:58.128541 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.128517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:58.171340 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.171322 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tpnl_9ae7f047-c5a7-46f2-b739-7380f69e766c/dns-node-resolver/0.log" Jul 14 14:30:58.206361 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.206340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2chr\" (UniqueName: \"kubernetes.io/projected/4e083cfb-e893-4a0c-8269-980edf0b9dbd-kube-api-access-t2chr\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.206446 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.206374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4e083cfb-e893-4a0c-8269-980edf0b9dbd-signing-key\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.206446 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.206410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4e083cfb-e893-4a0c-8269-980edf0b9dbd-signing-cabundle\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.306707 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.306687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2chr\" (UniqueName: \"kubernetes.io/projected/4e083cfb-e893-4a0c-8269-980edf0b9dbd-kube-api-access-t2chr\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.306798 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.306725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4e083cfb-e893-4a0c-8269-980edf0b9dbd-signing-key\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.306798 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.306761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4e083cfb-e893-4a0c-8269-980edf0b9dbd-signing-cabundle\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.307296 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.307281 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4e083cfb-e893-4a0c-8269-980edf0b9dbd-signing-cabundle\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.309175 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.309153 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4e083cfb-e893-4a0c-8269-980edf0b9dbd-signing-key\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.314860 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.314842 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2chr\" (UniqueName: \"kubernetes.io/projected/4e083cfb-e893-4a0c-8269-980edf0b9dbd-kube-api-access-t2chr\") pod \"service-ca-79f68b9f4f-wz5bl\" (UID: \"4e083cfb-e893-4a0c-8269-980edf0b9dbd\") " pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.399227 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.399168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" Jul 14 14:30:58.516163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.516134 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-wz5bl"] Jul 14 14:30:58.518993 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:30:58.518969 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e083cfb_e893_4a0c_8269_980edf0b9dbd.slice/crio-cfc426644f90d328889d72a14747f2ca505cb772df4eb51a97a4817cd10d5426 WatchSource:0}: Error finding container cfc426644f90d328889d72a14747f2ca505cb772df4eb51a97a4817cd10d5426: Status 404 returned error can't find the container with id cfc426644f90d328889d72a14747f2ca505cb772df4eb51a97a4817cd10d5426 Jul 14 14:30:58.575191 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.575169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" event={"ID":"4e083cfb-e893-4a0c-8269-980edf0b9dbd","Type":"ContainerStarted","Data":"cfc426644f90d328889d72a14747f2ca505cb772df4eb51a97a4817cd10d5426"} Jul 14 14:30:58.641606 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:58.641574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:59.173760 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.173732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:30:59.374550 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.374528 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lkmv6_10382172-3705-48c8-bcf0-200aff807c59/node-ca/0.log" Jul 14 14:30:59.579695 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.579664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" event={"ID":"4e083cfb-e893-4a0c-8269-980edf0b9dbd","Type":"ContainerStarted","Data":"c04e044aab661bbc603be1b411f0257d6bcb5fc84ba551f3731d342884a95036"} Jul 14 14:30:59.611130 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.611087 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-wz5bl" podStartSLOduration=1.611073255 podStartE2EDuration="1.611073255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:30:59.610336719 +0000 UTC m=+81.917982168" watchObservedRunningTime="2026-07-14 14:30:59.611073255 +0000 UTC m=+81.918718703" Jul 14 14:30:59.715531 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.715507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:59.715638 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.715570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:30:59.715638 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:59.715629 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:30:59.715742 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:59.715673 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:30:59.715742 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:59.715691 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:31:03.715673162 +0000 UTC m=+86.023318605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : configmap "kube-rbac-proxy" not found Jul 14 14:30:59.715742 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:30:59.715719 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:31:03.715708904 +0000 UTC m=+86.023354331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : secret "insights-runtime-extractor-tls" not found Jul 14 14:30:59.976370 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:30:59.976339 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfzpd_087142ff-5423-41d4-b1f6-1df250d0e444/serve-healthcheck-canary/0.log" Jul 14 14:31:00.035968 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.035938 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:00.193503 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.193447 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:00.319167 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.319091 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:00.409217 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.409191 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:00.477094 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.477052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:00.773892 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.773863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:00.775344 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:00.775320 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bn2gz_6406a951-eecf-4c6e-98fd-98e5b434f4cf/kube-storage-version-migrator-operator/0.log" Jul 14 14:31:01.734663 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:01.734625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:02.131356 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:02.131278 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:02.707556 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:02.707525 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:02.794214 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:02.794183 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:02.928927 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:02.928902 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:03.333236 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:03.333211 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:03.726472 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:03.726433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:03.746388 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:03.746367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:03.746532 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:03.746414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:03.746532 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:03.746488 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:31:03.746617 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:03.746542 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:31:11.746526517 +0000 UTC m=+94.054171949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : configmap "kube-rbac-proxy" not found Jul 14 14:31:03.746617 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:03.746544 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:03.746617 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:03.746587 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls podName:386db8ca-8205-49d6-8998-099cc656148c nodeName:}" failed. No retries permitted until 2026-07-14 14:31:11.746576748 +0000 UTC m=+94.054222176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lrl8m" (UID: "386db8ca-8205-49d6-8998-099cc656148c") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:03.975075 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:03.975044 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:04.075237 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:04.075164 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:04.177890 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:04.177869 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:04.326408 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:04.326356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:04.727476 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:04.727439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:04.828532 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:04.828514 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:04.931642 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:04.931618 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:05.328799 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:05.328769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:05.960618 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:05.960590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:31:05.960791 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:05.960639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:31:05.960791 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:05.960782 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 14:31:05.960897 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:05.960839 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls podName:38f215a5-d203-4cbb-9d9f-9c64b40ba381 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:21.960821881 +0000 UTC m=+104.268467352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8hmn7" (UID: "38f215a5-d203-4cbb-9d9f-9c64b40ba381") : secret "cluster-monitoring-operator-tls" not found Jul 14 14:31:05.962983 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:05.962965 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c3a9671-6e84-4d06-9771-e99047ade8b1-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-cxxbv\" (UID: \"3c3a9671-6e84-4d06-9771-e99047ade8b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:31:06.078295 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.078275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" Jul 14 14:31:06.130145 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.130104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:06.210794 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.210738 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv"] Jul 14 14:31:06.318108 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.318069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:06.545725 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.545660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:06.602410 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.602383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" event={"ID":"3c3a9671-6e84-4d06-9771-e99047ade8b1","Type":"ContainerStarted","Data":"3122efabd2ad35195d1e704d73dd55a184b3479ffb94539cb5c6dbcff28a63d0"} Jul 14 14:31:06.734074 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:06.734043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:07.259422 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:07.259368 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:07.359684 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:07.359651 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:08.127521 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.127497 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:08.229650 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.229624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:08.526873 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.526842 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:08.610348 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.610322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" event={"ID":"3c3a9671-6e84-4d06-9771-e99047ade8b1","Type":"ContainerStarted","Data":"6bd2945e809826cd27d3bdfd09e2f6eaa0cbd150bd0859d9e0218d14a4752d60"} Jul 14 14:31:08.610637 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.610391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" event={"ID":"3c3a9671-6e84-4d06-9771-e99047ade8b1","Type":"ContainerStarted","Data":"1a24e7c7f5a966730a4440af9f6849542fdbf9c411b9af516c0e2228e44a0b62"} Jul 14 14:31:08.629644 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.629602 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-cxxbv" podStartSLOduration=16.804577568 podStartE2EDuration="18.629584396s" totalImagesPullingTime="1.825006828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:08.628619474 +0000 UTC m=+90.936264936" watchObservedRunningTime="2026-07-14 14:31:08.629584396 +0000 UTC m=+90.937229844" Jul 14 14:31:08.721933 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.721903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:08.976191 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:08.976166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:09.131594 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:09.131566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:10.187080 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:10.187049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:10.332235 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:10.332210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:10.527700 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:10.527639 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:10.729687 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:10.729658 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:11.022869 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:11.022840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:11.809686 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:11.809647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:11.810161 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:11.809713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:11.810356 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:11.810329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/386db8ca-8205-49d6-8998-099cc656148c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:11.812415 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:11.812387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/386db8ca-8205-49d6-8998-099cc656148c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrl8m\" (UID: \"386db8ca-8205-49d6-8998-099cc656148c\") " pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:11.880516 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:11.880494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrl8m" Jul 14 14:31:12.010251 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:12.010136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrl8m"] Jul 14 14:31:12.012763 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:12.012734 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386db8ca_8205_49d6_8998_099cc656148c.slice/crio-ab61964e31d9edbef8617a6a1dce1269142cff99234fe2322725347ec07baa68 WatchSource:0}: Error finding container ab61964e31d9edbef8617a6a1dce1269142cff99234fe2322725347ec07baa68: Status 404 returned error can't find the container with id ab61964e31d9edbef8617a6a1dce1269142cff99234fe2322725347ec07baa68 Jul 14 14:31:12.624069 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:12.624028 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrl8m" event={"ID":"386db8ca-8205-49d6-8998-099cc656148c","Type":"ContainerStarted","Data":"ab61964e31d9edbef8617a6a1dce1269142cff99234fe2322725347ec07baa68"} Jul 14 14:31:14.688263 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:14.688226 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:14.786890 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:14.786847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:14.888248 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:14.888208 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:14.993764 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:14.993680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:15.358754 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:15.358678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:15.416718 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:15.416684 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:15.750083 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:15.750056 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:15.851091 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:15.851062 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:16.569501 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.569477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:16.639370 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.639313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrl8m" event={"ID":"386db8ca-8205-49d6-8998-099cc656148c","Type":"ContainerStarted","Data":"cbc7dd5a85ccd2232b45710a93eef440bf6f83e39bd384c6ed61a4293533fc6b"} Jul 14 14:31:16.639480 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.639373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrl8m" event={"ID":"386db8ca-8205-49d6-8998-099cc656148c","Type":"ContainerStarted","Data":"84854d8a234171e02649989e3272a70765c0603a7c2303eb6bad98d5f09b13a6"} Jul 14 14:31:16.769696 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.769673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:16.869070 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.869048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:16.950117 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.950092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:31:16.950223 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.950122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:31:16.952229 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.952210 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8ce8931-520a-422e-ab09-8599f1ca6f1b-metrics-tls\") pod \"dns-default-jwmh9\" (UID: \"d8ce8931-520a-422e-ab09-8599f1ca6f1b\") " pod="openshift-dns/dns-default-jwmh9" Jul 14 14:31:16.952419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.952402 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"image-registry-7c54c48fb8-pplvc\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:31:16.979687 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.979667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f7csw\"" Jul 14 14:31:16.982878 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.982858 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:16.987511 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.987495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:31:16.997680 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:16.997662 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9k9pr\"" Jul 14 14:31:17.006536 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.006516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwmh9" Jul 14 14:31:17.049731 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.049582 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:17.121682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.121656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c54c48fb8-pplvc"] Jul 14 14:31:17.125680 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:17.125655 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bce890_d4d6_4a0a_a418_340cb3b492e9.slice/crio-ae6c10cf9ff6df164106803e01a5b7a5b1fde5b330664d963fee085bd00c19b6 WatchSource:0}: Error finding container ae6c10cf9ff6df164106803e01a5b7a5b1fde5b330664d963fee085bd00c19b6: Status 404 returned error can't find the container with id ae6c10cf9ff6df164106803e01a5b7a5b1fde5b330664d963fee085bd00c19b6 Jul 14 14:31:17.134737 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.134716 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwmh9"] Jul 14 14:31:17.138034 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:17.138012 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ce8931_520a_422e_ab09_8599f1ca6f1b.slice/crio-c85d42693d907e509c604e6f93fbff1e91975a773c784fb609de1ade9fb60e66 WatchSource:0}: Error finding container c85d42693d907e509c604e6f93fbff1e91975a773c784fb609de1ade9fb60e66: Status 404 returned error can't find the container with id c85d42693d907e509c604e6f93fbff1e91975a773c784fb609de1ade9fb60e66 Jul 14 14:31:17.644975 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.644889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" event={"ID":"24bce890-d4d6-4a0a-a418-340cb3b492e9","Type":"ContainerStarted","Data":"a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3"} Jul 14 14:31:17.644975 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.644951 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:31:17.644975 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.644975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" event={"ID":"24bce890-d4d6-4a0a-a418-340cb3b492e9","Type":"ContainerStarted","Data":"ae6c10cf9ff6df164106803e01a5b7a5b1fde5b330664d963fee085bd00c19b6"} Jul 14 14:31:17.646317 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:17.646287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwmh9" event={"ID":"d8ce8931-520a-422e-ab09-8599f1ca6f1b","Type":"ContainerStarted","Data":"c85d42693d907e509c604e6f93fbff1e91975a773c784fb609de1ade9fb60e66"} Jul 14 14:31:20.538100 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.538077 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vq5qb" Jul 14 14:31:20.553139 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.553091 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" podStartSLOduration=102.553055874 podStartE2EDuration="1m42.553055874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:17.666235465 +0000 UTC m=+99.973880916" watchObservedRunningTime="2026-07-14 14:31:20.553055874 +0000 UTC m=+102.860701325" Jul 14 14:31:20.659057 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.659025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrl8m" event={"ID":"386db8ca-8205-49d6-8998-099cc656148c","Type":"ContainerStarted","Data":"6c516573af4cd8b17a60f3cdbd828a9dde402994a6cf3e2c8dad5e836a56bf85"} Jul 14 14:31:20.660875 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.660853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwmh9" event={"ID":"d8ce8931-520a-422e-ab09-8599f1ca6f1b","Type":"ContainerStarted","Data":"1f2de509b738c4515fd46f13e6a0a42989c58e8eea9faa55a4d6b6e25b6bd4fa"} Jul 14 14:31:20.660958 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.660896 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jwmh9" Jul 14 14:31:20.660958 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.660912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwmh9" event={"ID":"d8ce8931-520a-422e-ab09-8599f1ca6f1b","Type":"ContainerStarted","Data":"8c2324075c088aa09910aa46f429f9a474e7df1e4053ed30d9cdc576dc894b08"} Jul 14 14:31:20.678365 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.678300 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lrl8m" podStartSLOduration=17.426556563 podStartE2EDuration="25.678287631s" totalImagesPullingTime="8.251731068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:30:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:20.677164775 +0000 UTC m=+102.984810224" watchObservedRunningTime="2026-07-14 14:31:20.678287631 +0000 UTC m=+102.985933079" Jul 14 14:31:20.694336 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:20.694293 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jwmh9" podStartSLOduration=64.469122242 podStartE2EDuration="1m7.694280044s" totalImagesPullingTime="3.225157802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:20.69338842 +0000 UTC m=+103.001033867" watchObservedRunningTime="2026-07-14 14:31:20.694280044 +0000 UTC m=+103.001925493" Jul 14 14:31:21.821676 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:21.821640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:21.890230 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:21.890199 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:21.990471 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:21.990412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:31:21.992708 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:21.992687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f215a5-d203-4cbb-9d9f-9c64b40ba381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8hmn7\" (UID: \"38f215a5-d203-4cbb-9d9f-9c64b40ba381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:31:22.263528 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:22.263506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" Jul 14 14:31:22.304965 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:22.304941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:22.372382 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:22.372346 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:22.407507 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:22.407485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7"] Jul 14 14:31:22.410531 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:22.410504 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f215a5_d203_4cbb_9d9f_9c64b40ba381.slice/crio-f5734125cafdc3498195e60a4b505866c6e18ff9d52787265448a5a7f50e7357 WatchSource:0}: Error finding container f5734125cafdc3498195e60a4b505866c6e18ff9d52787265448a5a7f50e7357: Status 404 returned error can't find the container with id f5734125cafdc3498195e60a4b505866c6e18ff9d52787265448a5a7f50e7357 Jul 14 14:31:22.669141 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:22.669075 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" event={"ID":"38f215a5-d203-4cbb-9d9f-9c64b40ba381","Type":"ContainerStarted","Data":"f5734125cafdc3498195e60a4b505866c6e18ff9d52787265448a5a7f50e7357"} Jul 14 14:31:23.100218 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.100174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:23.207477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.207437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:23.314492 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.314444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:23.410046 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.409936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:23.515064 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.515036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:23.840305 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.840276 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:23.918885 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:23.918853 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:24.171632 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:24.171556 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:24.272276 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:24.272249 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:24.976396 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:24.976361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:25.314912 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.314885 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn"] Jul 14 14:31:25.316990 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.316973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:25.319382 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.319360 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 14:31:25.319521 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.319477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9zt4b\"" Jul 14 14:31:25.326115 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.326095 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn"] Jul 14 14:31:25.416338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.416316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ee29b61-8ae8-4d72-bf9f-96082d96bfca-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x5xzn\" (UID: \"7ee29b61-8ae8-4d72-bf9f-96082d96bfca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:25.517409 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.517386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ee29b61-8ae8-4d72-bf9f-96082d96bfca-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x5xzn\" (UID: \"7ee29b61-8ae8-4d72-bf9f-96082d96bfca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:25.517549 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:25.517532 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 14 14:31:25.517604 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:25.517594 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ee29b61-8ae8-4d72-bf9f-96082d96bfca-tls-certificates podName:7ee29b61-8ae8-4d72-bf9f-96082d96bfca nodeName:}" failed. No retries permitted until 2026-07-14 14:31:26.01757865 +0000 UTC m=+108.325224078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7ee29b61-8ae8-4d72-bf9f-96082d96bfca-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-x5xzn" (UID: "7ee29b61-8ae8-4d72-bf9f-96082d96bfca") : secret "prometheus-operator-admission-webhook-tls" not found Jul 14 14:31:25.680375 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.680344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" event={"ID":"38f215a5-d203-4cbb-9d9f-9c64b40ba381","Type":"ContainerStarted","Data":"01afb31a627943852742f0f05506a2c9b907b3fd162d46d402f045e7da597769"} Jul 14 14:31:25.699579 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.699531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8hmn7" podStartSLOduration=33.333214937 podStartE2EDuration="35.699509982s" totalImagesPullingTime="2.366295045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:25.698338489 +0000 UTC m=+108.005983937" watchObservedRunningTime="2026-07-14 14:31:25.699509982 +0000 UTC m=+108.007155432" Jul 14 14:31:25.756139 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.756108 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:25.857890 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:25.857864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:26.019746 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.019689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ee29b61-8ae8-4d72-bf9f-96082d96bfca-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x5xzn\" (UID: \"7ee29b61-8ae8-4d72-bf9f-96082d96bfca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:26.022164 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.022137 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ee29b61-8ae8-4d72-bf9f-96082d96bfca-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x5xzn\" (UID: \"7ee29b61-8ae8-4d72-bf9f-96082d96bfca\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:26.226554 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.226530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:26.350994 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.350964 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn"] Jul 14 14:31:26.354061 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:26.354035 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee29b61_8ae8_4d72_bf9f_96082d96bfca.slice/crio-8b94fdb6efc15227c111272a7fdc713b6fe623bdc8ae3fa9090af095a635a1db WatchSource:0}: Error finding container 8b94fdb6efc15227c111272a7fdc713b6fe623bdc8ae3fa9090af095a635a1db: Status 404 returned error can't find the container with id 8b94fdb6efc15227c111272a7fdc713b6fe623bdc8ae3fa9090af095a635a1db Jul 14 14:31:26.684849 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.684819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" event={"ID":"7ee29b61-8ae8-4d72-bf9f-96082d96bfca","Type":"ContainerStarted","Data":"8b94fdb6efc15227c111272a7fdc713b6fe623bdc8ae3fa9090af095a635a1db"} Jul 14 14:31:26.699201 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.699174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:26.800012 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.799986 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:26.864889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:26.864855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:28.693230 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:28.693200 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" event={"ID":"7ee29b61-8ae8-4d72-bf9f-96082d96bfca","Type":"ContainerStarted","Data":"f0d95e8c775f18548ab103ad9947fb441491fdcad8f3452ebcd0b2e19f3aa163"} Jul 14 14:31:28.693589 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:28.693399 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:28.697741 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:28.697714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" Jul 14 14:31:28.710628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:28.710589 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x5xzn" podStartSLOduration=1.9893311059999998 podStartE2EDuration="3.710577741s" totalImagesPullingTime="1.721246635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:28.70990314 +0000 UTC m=+111.017548588" watchObservedRunningTime="2026-07-14 14:31:28.710577741 +0000 UTC m=+111.018223190" Jul 14 14:31:29.349616 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.349584 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:29.391277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.391250 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xb7wl"] Jul 14 14:31:29.394495 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.394478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.397378 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.397363 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 14:31:29.398482 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.398443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 14:31:29.398482 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.398443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j9gcv\"" Jul 14 14:31:29.398613 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.398447 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 14:31:29.457136 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.457116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:29.462781 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.462752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xb7wl"] Jul 14 14:31:29.546238 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.546213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.546364 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.546250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.546364 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.546272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzswh\" (UniqueName: \"kubernetes.io/projected/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-kube-api-access-fzswh\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.546364 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.546290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.646967 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.646896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.646967 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.646936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.646967 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.646963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzswh\" (UniqueName: \"kubernetes.io/projected/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-kube-api-access-fzswh\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.647150 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.646991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.647150 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:29.647091 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 14:31:29.647222 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:29.647155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-tls podName:bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:30.147136244 +0000 UTC m=+112.454781672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-tls") pod "prometheus-operator-64785b6675-xb7wl" (UID: "bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b") : secret "prometheus-operator-tls" not found Jul 14 14:31:29.647659 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.647638 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.649216 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.649194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.656205 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.656186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzswh\" (UniqueName: \"kubernetes.io/projected/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-kube-api-access-fzswh\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:29.741987 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:29.741949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:30.151231 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.151205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:30.153344 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.153322 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xb7wl\" (UID: \"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:30.303421 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.303403 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" Jul 14 14:31:30.424991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.424945 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xb7wl"] Jul 14 14:31:30.427831 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:30.427794 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb4ab15_d10a_4d02_a6e6_e2a2d6d5383b.slice/crio-b8963728abfc375cf6886b24c23750c41e083aeeef2781d716b40418e858a1d1 WatchSource:0}: Error finding container b8963728abfc375cf6886b24c23750c41e083aeeef2781d716b40418e858a1d1: Status 404 returned error can't find the container with id b8963728abfc375cf6886b24c23750c41e083aeeef2781d716b40418e858a1d1 Jul 14 14:31:30.666488 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.666449 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jwmh9" Jul 14 14:31:30.701780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.701711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" event={"ID":"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b","Type":"ContainerStarted","Data":"b8963728abfc375cf6886b24c23750c41e083aeeef2781d716b40418e858a1d1"} Jul 14 14:31:30.802468 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.802418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:30.873207 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:30.873180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:31.457425 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:31.457397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:32.161300 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.161208 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:32.415020 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.414965 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:32.429662 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.429626 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5978797559-bbpcx"] Jul 14 14:31:32.435011 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.434990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.437894 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.437873 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 14:31:32.438859 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.438838 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 14:31:32.438937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.438906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 14:31:32.438937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.438860 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 14:31:32.439102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.438973 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 14:31:32.439102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.438848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qhv7n\"" Jul 14 14:31:32.439102 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.439076 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 14:31:32.439243 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.439153 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 14:31:32.441201 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.441165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5978797559-bbpcx"] Jul 14 14:31:32.484330 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.484310 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:32.572266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.572237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-service-ca\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.572266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.572268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-oauth-config\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.572438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.572327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg84n\" (UniqueName: \"kubernetes.io/projected/a3d4e719-a008-4245-af28-8641a5c07f4e-kube-api-access-kg84n\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.572438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.572350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-console-config\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.572438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.572366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-oauth-serving-cert\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.572438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.572399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-serving-cert\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.666339 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.666262 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:32.673277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-console-config\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.673277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-oauth-serving-cert\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.673477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-serving-cert\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.673477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-service-ca\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.673477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-oauth-config\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.673477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg84n\" (UniqueName: \"kubernetes.io/projected/a3d4e719-a008-4245-af28-8641a5c07f4e-kube-api-access-kg84n\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.674026 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.673999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-oauth-serving-cert\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.674121 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.674066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-service-ca\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.674121 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.674079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-console-config\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.675777 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.675761 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-oauth-config\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.675846 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.675819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-serving-cert\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.683138 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.683120 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg84n\" (UniqueName: \"kubernetes.io/projected/a3d4e719-a008-4245-af28-8641a5c07f4e-kube-api-access-kg84n\") pod \"console-5978797559-bbpcx\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.710300 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.710274 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" event={"ID":"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b","Type":"ContainerStarted","Data":"58cad576b342c4d956653817c5ce723612deb49ed68eedbe356a5629d8c1441f"} Jul 14 14:31:32.710385 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.710334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" event={"ID":"bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b","Type":"ContainerStarted","Data":"b421b569160d6644f5434597846df5ee98e1294a7bf5c861e4f040fdeef12f24"} Jul 14 14:31:32.733497 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.733433 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xb7wl" podStartSLOduration=1.780370736 podStartE2EDuration="3.733419994s" totalImagesPullingTime="1.953049258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:32.733099354 +0000 UTC m=+115.040744803" watchObservedRunningTime="2026-07-14 14:31:32.733419994 +0000 UTC m=+115.041065444" Jul 14 14:31:32.745202 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.745181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:32.873326 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:32.873300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5978797559-bbpcx"] Jul 14 14:31:32.876679 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:32.876651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d4e719_a008_4245_af28_8641a5c07f4e.slice/crio-e075a52201ba6b387f817125106c7a7eb26332df5d5bd553d74e861080d8eac2 WatchSource:0}: Error finding container e075a52201ba6b387f817125106c7a7eb26332df5d5bd553d74e861080d8eac2: Status 404 returned error can't find the container with id e075a52201ba6b387f817125106c7a7eb26332df5d5bd553d74e861080d8eac2 Jul 14 14:31:33.715055 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.715011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5978797559-bbpcx" event={"ID":"a3d4e719-a008-4245-af28-8641a5c07f4e","Type":"ContainerStarted","Data":"e075a52201ba6b387f817125106c7a7eb26332df5d5bd553d74e861080d8eac2"} Jul 14 14:31:33.804418 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.804388 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5494bc499-8gfns"] Jul 14 14:31:33.807682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.807656 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.810267 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.810223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:33.816872 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.816845 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 14:31:33.819246 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.819223 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5494bc499-8gfns"] Jul 14 14:31:33.887041 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.886992 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:33.983991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.983919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-oauth-config\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.983991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.983946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-config\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.983991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.983971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tjj\" (UniqueName: \"kubernetes.io/projected/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-kube-api-access-p9tjj\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.983991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.983991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-trusted-ca-bundle\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.984245 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.984061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-oauth-serving-cert\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.984245 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.984116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-service-ca\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.984245 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.984153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-serving-cert\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:33.989275 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:33.989252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:34.084647 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-trusted-ca-bundle\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.084734 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-oauth-serving-cert\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.084734 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-service-ca\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.084843 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-serving-cert\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.084890 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-oauth-config\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.084938 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-config\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.084938 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.084928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tjj\" (UniqueName: \"kubernetes.io/projected/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-kube-api-access-p9tjj\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.085702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.085404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-oauth-serving-cert\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.085702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.085566 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-service-ca\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.085702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.085627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-trusted-ca-bundle\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.085702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.085665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-config\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.087616 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.087596 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-serving-cert\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.087714 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.087689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-oauth-config\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.095221 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.095192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tjj\" (UniqueName: \"kubernetes.io/projected/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-kube-api-access-p9tjj\") pod \"console-5494bc499-8gfns\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.119902 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.119869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:34.258261 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.258195 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5494bc499-8gfns"] Jul 14 14:31:34.261688 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:34.261663 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefaba9ca_2f1a_45a3_98b2_456a9dbee9e0.slice/crio-8a35b9c611fa340871ef6fb470fda25bfbfb1e2a8dddaf1b8c96c02858d87e1d WatchSource:0}: Error finding container 8a35b9c611fa340871ef6fb470fda25bfbfb1e2a8dddaf1b8c96c02858d87e1d: Status 404 returned error can't find the container with id 8a35b9c611fa340871ef6fb470fda25bfbfb1e2a8dddaf1b8c96c02858d87e1d Jul 14 14:31:34.510304 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.510214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:34.724029 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.723277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bc499-8gfns" event={"ID":"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0","Type":"ContainerStarted","Data":"8a35b9c611fa340871ef6fb470fda25bfbfb1e2a8dddaf1b8c96c02858d87e1d"} Jul 14 14:31:34.747127 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.747095 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:34.797153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.795640 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gfllm"] Jul 14 14:31:34.799622 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.799598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:34.803529 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.803508 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 14:31:34.803757 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.803742 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 14:31:34.804295 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.803927 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-77gdh\"" Jul 14 14:31:34.805711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.805269 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 14:31:34.816610 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.816523 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gfllm"] Jul 14 14:31:34.817582 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.817300 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-47fjv"] Jul 14 14:31:34.820861 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.820841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.824726 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.824562 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 14:31:34.825110 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.824960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 14:31:34.825110 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.824988 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 14:31:34.826373 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.825528 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cg2mv\"" Jul 14 14:31:34.861166 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.861099 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:34.981787 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.981755 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:34.997970 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.997922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-wtmp\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998085 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.997994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-metrics-client-ca\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998085 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-textfile\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998085 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998226 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-root\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998226 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998226 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998226 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02e2b10d-9c15-4276-9f46-0d08afb48411-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:34.998226 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:34.998414 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-sys\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998414 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:34.998414 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl28b\" (UniqueName: \"kubernetes.io/projected/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-kube-api-access-rl28b\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:34.998414 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:34.998414 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e2b10d-9c15-4276-9f46-0d08afb48411-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:34.998414 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:34.998383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrxq2\" (UniqueName: \"kubernetes.io/projected/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-api-access-zrxq2\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.099507 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.099507 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-root\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:35.099566 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02e2b10d-9c15-4276-9f46-0d08afb48411-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:35.099634 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls podName:6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:35.599613544 +0000 UTC m=+117.907258988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls") pod "node-exporter-47fjv" (UID: "6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7") : secret "node-exporter-tls" not found Jul 14 14:31:35.099702 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-sys\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl28b\" (UniqueName: \"kubernetes.io/projected/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-kube-api-access-rl28b\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e2b10d-9c15-4276-9f46-0d08afb48411-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrxq2\" (UniqueName: \"kubernetes.io/projected/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-api-access-zrxq2\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-wtmp\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-metrics-client-ca\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.099978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-textfile\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100425 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.100331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-textfile\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100499 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.100443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-sys\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.100561 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.100507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-wtmp\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.101362 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.101075 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-metrics-client-ca\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.101362 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.101138 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-root\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.101362 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.101223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e2b10d-9c15-4276-9f46-0d08afb48411-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.101362 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.101223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.101650 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.101513 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02e2b10d-9c15-4276-9f46-0d08afb48411-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.101650 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.101589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.102982 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.102940 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.103279 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.103255 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.104710 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.104687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.112782 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.112740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl28b\" (UniqueName: \"kubernetes.io/projected/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-kube-api-access-rl28b\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.114405 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.114377 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrxq2\" (UniqueName: \"kubernetes.io/projected/02e2b10d-9c15-4276-9f46-0d08afb48411-kube-api-access-zrxq2\") pod \"kube-state-metrics-785778ff74-gfllm\" (UID: \"02e2b10d-9c15-4276-9f46-0d08afb48411\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.116287 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.115912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" Jul 14 14:31:35.465648 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.465594 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:35.605370 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.605330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:35.605647 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:35.605547 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 14:31:35.605779 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:35.605654 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls podName:6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:36.605630875 +0000 UTC m=+118.913276303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls") pod "node-exporter-47fjv" (UID: "6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7") : secret "node-exporter-tls" not found Jul 14 14:31:35.632617 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.632584 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:35.782501 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.782350 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:35.870624 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.870527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:35.874908 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.874881 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:31:35.885770 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.885747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889364 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-msksj\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889368 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889530 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889552 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889617 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889669 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 14:31:35.889784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.889778 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 14:31:35.890282 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.890003 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 14:31:35.899941 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.899920 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:31:35.908285 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t2kz\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-kube-api-access-2t2kz\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908449 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908449 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908449 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908449 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-out\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.908837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.908775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-web-config\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:35.993689 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:35.993608 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:36.009804 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-web-config\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.009941 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t2kz\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-kube-api-access-2t2kz\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.009941 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.009941 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.009941 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.010153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.010153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.009989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.010153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.010025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-out\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.010153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.010059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.010861 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.010810 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.011962 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.011040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.011962 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.011088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.011962 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.011143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.011962 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.011162 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.011962 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.011166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.012684 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.012655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.015599 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.015553 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.017175 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.017150 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.018056 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.018012 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-web-config\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.018593 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.018569 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.018593 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.018588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.018858 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.018843 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.019655 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.019538 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.020616 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.020594 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-out\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.021755 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.021731 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.022355 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.022332 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t2kz\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-kube-api-access-2t2kz\") pod \"alertmanager-main-0\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.203117 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.203092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:31:36.255477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.255379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gfllm"] Jul 14 14:31:36.259604 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:36.259563 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e2b10d_9c15_4276_9f46_0d08afb48411.slice/crio-0094b3b0786c8c17b4ffd9975f05c4e41d1cd9fd59915b6cc09331fe2e20bc53 WatchSource:0}: Error finding container 0094b3b0786c8c17b4ffd9975f05c4e41d1cd9fd59915b6cc09331fe2e20bc53: Status 404 returned error can't find the container with id 0094b3b0786c8c17b4ffd9975f05c4e41d1cd9fd59915b6cc09331fe2e20bc53 Jul 14 14:31:36.390714 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.390628 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:31:36.395236 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:36.395204 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8aa974_ea3a_46c0_910b_d8b7b1edb457.slice/crio-cdad57fee87f4f44e2036bef0aab19795025aa18d198bde7b081eb49bbebddf3 WatchSource:0}: Error finding container cdad57fee87f4f44e2036bef0aab19795025aa18d198bde7b081eb49bbebddf3: Status 404 returned error can't find the container with id cdad57fee87f4f44e2036bef0aab19795025aa18d198bde7b081eb49bbebddf3 Jul 14 14:31:36.513748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.513715 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:36.618514 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.618478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:36.620979 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.620952 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7-node-exporter-tls\") pod \"node-exporter-47fjv\" (UID: \"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7\") " pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:36.651722 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.651655 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47fjv" Jul 14 14:31:36.663736 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:36.663713 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6fac26_46c8_4c31_9d0d_cfdec4dba7a7.slice/crio-d82623b8987b5c6cf7e8377541bef20ccec10f844bb4133e4c7f7ae5aeb0889d WatchSource:0}: Error finding container d82623b8987b5c6cf7e8377541bef20ccec10f844bb4133e4c7f7ae5aeb0889d: Status 404 returned error can't find the container with id d82623b8987b5c6cf7e8377541bef20ccec10f844bb4133e4c7f7ae5aeb0889d Jul 14 14:31:36.737821 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.737788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bc499-8gfns" event={"ID":"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0","Type":"ContainerStarted","Data":"76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37"} Jul 14 14:31:36.738848 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.738825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" event={"ID":"02e2b10d-9c15-4276-9f46-0d08afb48411","Type":"ContainerStarted","Data":"0094b3b0786c8c17b4ffd9975f05c4e41d1cd9fd59915b6cc09331fe2e20bc53"} Jul 14 14:31:36.739898 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.739878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47fjv" event={"ID":"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7","Type":"ContainerStarted","Data":"d82623b8987b5c6cf7e8377541bef20ccec10f844bb4133e4c7f7ae5aeb0889d"} Jul 14 14:31:36.741237 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.741212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5978797559-bbpcx" event={"ID":"a3d4e719-a008-4245-af28-8641a5c07f4e","Type":"ContainerStarted","Data":"f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296"} Jul 14 14:31:36.742292 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.742269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"cdad57fee87f4f44e2036bef0aab19795025aa18d198bde7b081eb49bbebddf3"} Jul 14 14:31:36.758287 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.758244 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5494bc499-8gfns" podStartSLOduration=1.88039464 podStartE2EDuration="3.758231449s" totalImagesPullingTime="1.877836809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:36.757776645 +0000 UTC m=+119.065422096" watchObservedRunningTime="2026-07-14 14:31:36.758231449 +0000 UTC m=+119.065876898" Jul 14 14:31:36.765022 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.764995 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:36.784741 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.784689 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5978797559-bbpcx" podStartSLOduration=1.5229093900000001 podStartE2EDuration="4.784671023s" totalImagesPullingTime="3.261761633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:36.782388061 +0000 UTC m=+119.090033541" watchObservedRunningTime="2026-07-14 14:31:36.784671023 +0000 UTC m=+119.092316474" Jul 14 14:31:36.844035 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:36.843999 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:37.343477 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:37.343433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:37.827082 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:37.827045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:37.927948 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:37.927914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:38.137592 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.137568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:38.234549 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.234441 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:38.655598 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.655517 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:31:38.752604 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.752575 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7" containerID="c007ebc3285c9ade45eba00b82a0698fcd086f35e179d159552bd2b4f0ea7e7b" exitCode=0 Jul 14 14:31:38.752749 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.752666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47fjv" event={"ID":"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7","Type":"ContainerDied","Data":"c007ebc3285c9ade45eba00b82a0698fcd086f35e179d159552bd2b4f0ea7e7b"} Jul 14 14:31:38.754196 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.754170 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284" exitCode=0 Jul 14 14:31:38.754299 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.754258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284"} Jul 14 14:31:38.756579 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.756554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" event={"ID":"02e2b10d-9c15-4276-9f46-0d08afb48411","Type":"ContainerStarted","Data":"62d2da3d0fcc9bd5fd2d876da0555d23505d556dcfd2bc627129cf38295d8842"} Jul 14 14:31:38.756688 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.756604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" event={"ID":"02e2b10d-9c15-4276-9f46-0d08afb48411","Type":"ContainerStarted","Data":"3c37fd484c2e58883bb1c30a998cc38ce0fac16f9bf20a9f4b1f33d89159e8cc"} Jul 14 14:31:38.756688 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.756628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" event={"ID":"02e2b10d-9c15-4276-9f46-0d08afb48411","Type":"ContainerStarted","Data":"1457fe40c261655a728386cc8c73a0c49f1258aba8be0cfe773b7b6a65cd29e7"} Jul 14 14:31:38.796991 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.796930 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-gfllm" podStartSLOduration=2.972488135 podStartE2EDuration="4.796916629s" totalImagesPullingTime="1.824428494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:38.795316241 +0000 UTC m=+121.102961702" watchObservedRunningTime="2026-07-14 14:31:38.796916629 +0000 UTC m=+121.104562101" Jul 14 14:31:38.959374 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:38.959340 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.024051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.024025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.547489 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.547439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.554425 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.554400 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8252d"] Jul 14 14:31:39.557565 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.557548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:39.561712 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.561689 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mwbls\"" Jul 14 14:31:39.561803 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.561779 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 14:31:39.571775 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.571753 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8252d"] Jul 14 14:31:39.637888 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.637852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.647442 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.647419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q848b\" (UniqueName: \"kubernetes.io/projected/39a5d93b-302e-472b-96e2-d992472ff7a8-kube-api-access-q848b\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:39.647543 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.647472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39a5d93b-302e-472b-96e2-d992472ff7a8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:39.748332 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.748301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q848b\" (UniqueName: \"kubernetes.io/projected/39a5d93b-302e-472b-96e2-d992472ff7a8-kube-api-access-q848b\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:39.748332 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.748338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39a5d93b-302e-472b-96e2-d992472ff7a8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:39.748604 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:39.748489 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 14 14:31:39.748604 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:31:39.748539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39a5d93b-302e-472b-96e2-d992472ff7a8-monitoring-plugin-cert podName:39a5d93b-302e-472b-96e2-d992472ff7a8 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:40.248525667 +0000 UTC m=+122.556171095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/39a5d93b-302e-472b-96e2-d992472ff7a8-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-8252d" (UID: "39a5d93b-302e-472b-96e2-d992472ff7a8") : secret "monitoring-plugin-cert" not found Jul 14 14:31:39.760470 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.760433 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q848b\" (UniqueName: \"kubernetes.io/projected/39a5d93b-302e-472b-96e2-d992472ff7a8-kube-api-access-q848b\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:39.763519 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.763488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47fjv" event={"ID":"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7","Type":"ContainerStarted","Data":"0995cb382d6e9afdfdf2e998185118034288e17f285cbd52146f549c47b1918a"} Jul 14 14:31:39.763632 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.763552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47fjv" event={"ID":"6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7","Type":"ContainerStarted","Data":"fa6490b42510bb1fefefbaf6b5db162bddc9e76d42ee00c76805f315fb74cfc8"} Jul 14 14:31:39.784828 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.784742 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-47fjv" podStartSLOduration=4.277151416 podStartE2EDuration="5.784722635s" totalImagesPullingTime="1.421827665s" totalInitContainerRuntime="85.743554ms" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:39.783920015 +0000 UTC m=+122.091565466" watchObservedRunningTime="2026-07-14 14:31:39.784722635 +0000 UTC m=+122.092368088" Jul 14 14:31:39.899086 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:39.899009 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:40.009105 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.009068 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5978797559-bbpcx"] Jul 14 14:31:40.256271 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.256234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39a5d93b-302e-472b-96e2-d992472ff7a8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:40.259473 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.259425 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39a5d93b-302e-472b-96e2-d992472ff7a8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-8252d\" (UID: \"39a5d93b-302e-472b-96e2-d992472ff7a8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:40.409907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.409868 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:40.467943 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.467922 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:40.536115 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.536031 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:40.615754 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.615728 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-8252d"] Jul 14 14:31:40.619994 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:40.619962 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a5d93b_302e_472b_96e2_d992472ff7a8.slice/crio-0f6f83190c206bbcc868613d436b09f1dd6c0f22bc28ca1abb23058eb656fa87 WatchSource:0}: Error finding container 0f6f83190c206bbcc868613d436b09f1dd6c0f22bc28ca1abb23058eb656fa87: Status 404 returned error can't find the container with id 0f6f83190c206bbcc868613d436b09f1dd6c0f22bc28ca1abb23058eb656fa87 Jul 14 14:31:40.769919 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.769832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" event={"ID":"39a5d93b-302e-472b-96e2-d992472ff7a8","Type":"ContainerStarted","Data":"0f6f83190c206bbcc868613d436b09f1dd6c0f22bc28ca1abb23058eb656fa87"} Jul 14 14:31:40.773196 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.773171 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261"} Jul 14 14:31:40.773336 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.773240 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef"} Jul 14 14:31:40.773336 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.773290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f"} Jul 14 14:31:40.773336 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.773326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63"} Jul 14 14:31:40.773489 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:40.773370 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b"} Jul 14 14:31:41.071490 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.071368 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:31:41.079466 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.079430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.082214 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 14:31:41.082333 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 14:31:41.082333 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 14:31:41.082505 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082487 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 14:31:41.082836 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 14:31:41.082836 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 14:31:41.082983 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.082843 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ass7b4hpeinin\"" Jul 14 14:31:41.083058 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 14:31:41.083325 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083308 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 14:31:41.083448 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083421 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 14:31:41.083576 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083320 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 14:31:41.083576 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 14:31:41.083695 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083364 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sxglt\"" Jul 14 14:31:41.083695 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 14:31:41.083695 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.083316 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 14:31:41.084259 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.084195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 14:31:41.087688 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.087667 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 14:31:41.105990 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.105960 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:31:41.164561 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-web-config\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164709 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164709 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164709 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-config\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164992 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164992 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164992 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.164992 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.164975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165135 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbz2x\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-kube-api-access-vbz2x\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165182 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-config-out\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165182 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165260 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165299 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.165417 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.165368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.266962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-web-config\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-config\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbz2x\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-kube-api-access-vbz2x\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-config-out\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.267438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.268247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.268293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.268321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.268354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.268384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.270037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.270316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.271426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.272337 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.272947 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.272517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.273487 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.272976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-web-config\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.273742 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.273715 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.273924 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.273896 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.278720 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.274547 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.278906 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.278850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.281045 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.280971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.281656 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.281217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.281656 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.281426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-config-out\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.287798 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.287751 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.288628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.288586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.288968 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.288755 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-config\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.288968 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.288919 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.294375 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.289143 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.294375 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.292904 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.294375 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.294002 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbz2x\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-kube-api-access-vbz2x\") pod \"prometheus-k8s-0\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.298695 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.298616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:41.393601 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.393411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:41.435908 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.435871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:41.585606 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.585509 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:31:41.699156 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:41.699126 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935653aa_31cb_4b28_a51b_739507ff9011.slice/crio-5c4a74e84eb62549b9591c1819a7936185499997e646757cadc99a1b636e036f WatchSource:0}: Error finding container 5c4a74e84eb62549b9591c1819a7936185499997e646757cadc99a1b636e036f: Status 404 returned error can't find the container with id 5c4a74e84eb62549b9591c1819a7936185499997e646757cadc99a1b636e036f Jul 14 14:31:41.779691 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:41.779656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"5c4a74e84eb62549b9591c1819a7936185499997e646757cadc99a1b636e036f"} Jul 14 14:31:42.004910 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.004822 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:42.105260 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.105214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:42.745734 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.745692 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:31:42.785629 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.785587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" event={"ID":"39a5d93b-302e-472b-96e2-d992472ff7a8","Type":"ContainerStarted","Data":"03bf2ac6e6e71b260ad14edff6804820641d5ff929445680b88f81a84c7d4681"} Jul 14 14:31:42.785845 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.785754 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:42.789363 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.789336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerStarted","Data":"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7"} Jul 14 14:31:42.791344 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.791308 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" Jul 14 14:31:42.791483 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.791419 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" exitCode=0 Jul 14 14:31:42.791483 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.791472 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} Jul 14 14:31:42.804204 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.804158 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-8252d" podStartSLOduration=2.342106162 podStartE2EDuration="3.804144163s" totalImagesPullingTime="1.462038001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:42.802604327 +0000 UTC m=+125.110249777" watchObservedRunningTime="2026-07-14 14:31:42.804144163 +0000 UTC m=+125.111789613" Jul 14 14:31:42.836145 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:42.836093 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.128532173 podStartE2EDuration="7.836060242s" totalImagesPullingTime="4.677970607s" totalInitContainerRuntime="29.557462ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:42.834662261 +0000 UTC m=+125.142307711" watchObservedRunningTime="2026-07-14 14:31:42.836060242 +0000 UTC m=+125.143705693" Jul 14 14:31:44.120515 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:44.120480 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:44.120988 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:44.120574 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:44.126266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:44.126241 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:44.309935 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:44.309891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:44.404476 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:44.404371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:44.813765 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:44.813734 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:31:45.443888 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:45.443850 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:45.937817 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:45.937764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:46.817087 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:46.817013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} Jul 14 14:31:46.817087 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:46.817084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} Jul 14 14:31:47.228117 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:47.228085 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c54c48fb8-pplvc"] Jul 14 14:31:47.323551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:47.323391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:47.421972 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:47.421938 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:48.040520 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.040485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:31:48.043130 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.043104 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/799ad4f3-3e43-40aa-87d9-cb11ce14c188-metrics-certs\") pod \"network-metrics-daemon-42nkf\" (UID: \"799ad4f3-3e43-40aa-87d9-cb11ce14c188\") " pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:31:48.308703 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.308627 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7rw9n\"" Jul 14 14:31:48.316258 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.316233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42nkf" Jul 14 14:31:48.783792 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.783765 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-42nkf"] Jul 14 14:31:48.787833 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:48.787789 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799ad4f3_3e43_40aa_87d9_cb11ce14c188.slice/crio-61781a31103ba037ddd144a791bad5fe9e14b88bc26add0b36ea3df2e2d153ca WatchSource:0}: Error finding container 61781a31103ba037ddd144a791bad5fe9e14b88bc26add0b36ea3df2e2d153ca: Status 404 returned error can't find the container with id 61781a31103ba037ddd144a791bad5fe9e14b88bc26add0b36ea3df2e2d153ca Jul 14 14:31:48.830923 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.830893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-42nkf" event={"ID":"799ad4f3-3e43-40aa-87d9-cb11ce14c188","Type":"ContainerStarted","Data":"61781a31103ba037ddd144a791bad5fe9e14b88bc26add0b36ea3df2e2d153ca"} Jul 14 14:31:48.833686 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:48.833653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} Jul 14 14:31:49.776408 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.776370 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:49.833826 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.833794 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:49.839146 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.839119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-42nkf" event={"ID":"799ad4f3-3e43-40aa-87d9-cb11ce14c188","Type":"ContainerStarted","Data":"3a9a313ffc3e414238d1aca008463cb6a5bebdab1fbd163fff1b3e3cf97c081c"} Jul 14 14:31:49.842637 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.842612 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} Jul 14 14:31:49.842750 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.842678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} Jul 14 14:31:49.842750 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.842721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerStarted","Data":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} Jul 14 14:31:49.919262 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:49.919214 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.134662786 podStartE2EDuration="8.919198398s" totalImagesPullingTime="5.758575322s" totalInitContainerRuntime="25.96029ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:49.914765121 +0000 UTC m=+132.222410571" watchObservedRunningTime="2026-07-14 14:31:49.919198398 +0000 UTC m=+132.226843848" Jul 14 14:31:50.848339 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:50.848309 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-42nkf" event={"ID":"799ad4f3-3e43-40aa-87d9-cb11ce14c188","Type":"ContainerStarted","Data":"f02f267ff31438d086a5aab18be9adb7f3244be24644b686bacebf03bd7e588e"} Jul 14 14:31:50.869701 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:50.869658 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-42nkf" podStartSLOduration=131.982373173 podStartE2EDuration="2m12.869644097s" totalImagesPullingTime="887.270924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:50.867385908 +0000 UTC m=+133.175031357" watchObservedRunningTime="2026-07-14 14:31:50.869644097 +0000 UTC m=+133.177289546" Jul 14 14:31:50.950762 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:50.950733 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.051162 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.051126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.114233 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.114161 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.394125 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.394046 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:31:51.417334 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.417295 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5494bc499-8gfns"] Jul 14 14:31:51.534621 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.534574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.634684 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.634659 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.754853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:51.754815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:52.303861 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:52.303817 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:52.373607 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:52.373570 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:53.206832 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.206793 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c89fbd59-bbfwz"] Jul 14 14:31:53.211481 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.211440 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.231148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.231124 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c89fbd59-bbfwz"] Jul 14 14:31:53.287078 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljhrg\" (UniqueName: \"kubernetes.io/projected/34029023-31de-4aad-9be3-34225e2d12ba-kube-api-access-ljhrg\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.287078 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-oauth-serving-cert\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.287312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-trusted-ca-bundle\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.287312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-oauth-config\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.287312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-service-ca\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.287312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-serving-cert\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.287312 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.287229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-console-config\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388251 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljhrg\" (UniqueName: \"kubernetes.io/projected/34029023-31de-4aad-9be3-34225e2d12ba-kube-api-access-ljhrg\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-oauth-serving-cert\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-trusted-ca-bundle\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-oauth-config\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-service-ca\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-serving-cert\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.388748 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.388440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-console-config\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.389282 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.389228 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-oauth-serving-cert\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.389282 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.389271 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-service-ca\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.389482 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.389294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-console-config\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.389482 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.389392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-trusted-ca-bundle\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.391022 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.390997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-serving-cert\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.391124 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.391044 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-oauth-config\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.396417 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.396391 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljhrg\" (UniqueName: \"kubernetes.io/projected/34029023-31de-4aad-9be3-34225e2d12ba-kube-api-access-ljhrg\") pod \"console-66c89fbd59-bbfwz\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.520922 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.520821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:31:53.661530 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.661503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c89fbd59-bbfwz"] Jul 14 14:31:53.663267 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:31:53.663241 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34029023_31de_4aad_9be3_34225e2d12ba.slice/crio-c41c6aa24d521c459e5959cfbf316ec0477558eef9d69259de24d0ec4099d531 WatchSource:0}: Error finding container c41c6aa24d521c459e5959cfbf316ec0477558eef9d69259de24d0ec4099d531: Status 404 returned error can't find the container with id c41c6aa24d521c459e5959cfbf316ec0477558eef9d69259de24d0ec4099d531 Jul 14 14:31:53.861877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.861801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c89fbd59-bbfwz" event={"ID":"34029023-31de-4aad-9be3-34225e2d12ba","Type":"ContainerStarted","Data":"88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66"} Jul 14 14:31:53.861877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.861849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c89fbd59-bbfwz" event={"ID":"34029023-31de-4aad-9be3-34225e2d12ba","Type":"ContainerStarted","Data":"c41c6aa24d521c459e5959cfbf316ec0477558eef9d69259de24d0ec4099d531"} Jul 14 14:31:53.884329 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.884279 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c89fbd59-bbfwz" podStartSLOduration=0.884261427 podStartE2EDuration="884.261427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:53.882380007 +0000 UTC m=+136.190025455" watchObservedRunningTime="2026-07-14 14:31:53.884261427 +0000 UTC m=+136.191906877" Jul 14 14:31:53.976406 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:53.976379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:54.045155 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:54.045106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:57.180396 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:57.180364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:57.272338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:57.272303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:59.245386 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:59.245342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:59.346698 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:59.346660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:59.414371 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:31:59.414343 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:03.521615 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:03.521581 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:32:03.521981 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:03.521664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:32:03.526419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:03.526400 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:32:03.913530 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:03.913434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:32:04.087505 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:04.087475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:04.188197 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:04.188165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:04.240614 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:04.240587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:05.032110 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.032067 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5978797559-bbpcx" podUID="a3d4e719-a008-4245-af28-8641a5c07f4e" containerName="console" containerID="cri-o://f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296" gracePeriod=15 Jul 14 14:32:05.275917 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.275896 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:32:05.391970 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.391905 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-oauth-serving-cert\") pod \"a3d4e719-a008-4245-af28-8641a5c07f4e\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " Jul 14 14:32:05.391970 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.391940 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-service-ca\") pod \"a3d4e719-a008-4245-af28-8641a5c07f4e\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " Jul 14 14:32:05.391970 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.391961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-console-config\") pod \"a3d4e719-a008-4245-af28-8641a5c07f4e\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " Jul 14 14:32:05.392233 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.391982 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg84n\" (UniqueName: \"kubernetes.io/projected/a3d4e719-a008-4245-af28-8641a5c07f4e-kube-api-access-kg84n\") pod \"a3d4e719-a008-4245-af28-8641a5c07f4e\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " Jul 14 14:32:05.392233 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.392045 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-oauth-config\") pod \"a3d4e719-a008-4245-af28-8641a5c07f4e\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " Jul 14 14:32:05.392233 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.392060 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-serving-cert\") pod \"a3d4e719-a008-4245-af28-8641a5c07f4e\" (UID: \"a3d4e719-a008-4245-af28-8641a5c07f4e\") " Jul 14 14:32:05.392379 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.392297 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3d4e719-a008-4245-af28-8641a5c07f4e" (UID: "a3d4e719-a008-4245-af28-8641a5c07f4e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:05.392379 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.392342 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-console-config" (OuterVolumeSpecName: "console-config") pod "a3d4e719-a008-4245-af28-8641a5c07f4e" (UID: "a3d4e719-a008-4245-af28-8641a5c07f4e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:05.392612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.392587 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3d4e719-a008-4245-af28-8641a5c07f4e" (UID: "a3d4e719-a008-4245-af28-8641a5c07f4e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:05.394483 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.394423 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d4e719-a008-4245-af28-8641a5c07f4e-kube-api-access-kg84n" (OuterVolumeSpecName: "kube-api-access-kg84n") pod "a3d4e719-a008-4245-af28-8641a5c07f4e" (UID: "a3d4e719-a008-4245-af28-8641a5c07f4e"). InnerVolumeSpecName "kube-api-access-kg84n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:05.394579 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.394512 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3d4e719-a008-4245-af28-8641a5c07f4e" (UID: "a3d4e719-a008-4245-af28-8641a5c07f4e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:05.394803 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.394776 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3d4e719-a008-4245-af28-8641a5c07f4e" (UID: "a3d4e719-a008-4245-af28-8641a5c07f4e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:05.493009 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.492982 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-oauth-serving-cert\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:05.493009 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.493005 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-service-ca\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:05.493133 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.493015 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3d4e719-a008-4245-af28-8641a5c07f4e-console-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:05.493133 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.493022 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg84n\" (UniqueName: \"kubernetes.io/projected/a3d4e719-a008-4245-af28-8641a5c07f4e-kube-api-access-kg84n\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:05.493133 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.493031 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-oauth-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:05.493133 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.493039 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d4e719-a008-4245-af28-8641a5c07f4e-console-serving-cert\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:05.919252 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.919208 2577 generic.go:356] "Generic (PLEG): container finished" podID="a3d4e719-a008-4245-af28-8641a5c07f4e" containerID="f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296" exitCode=0 Jul 14 14:32:05.919422 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.919269 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5978797559-bbpcx" Jul 14 14:32:05.919422 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.919287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5978797559-bbpcx" event={"ID":"a3d4e719-a008-4245-af28-8641a5c07f4e","Type":"ContainerDied","Data":"f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296"} Jul 14 14:32:05.919422 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.919361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5978797559-bbpcx" event={"ID":"a3d4e719-a008-4245-af28-8641a5c07f4e","Type":"ContainerDied","Data":"e075a52201ba6b387f817125106c7a7eb26332df5d5bd553d74e861080d8eac2"} Jul 14 14:32:05.920080 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.920067 2577 scope.go:117] "RemoveContainer" containerID="f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296" Jul 14 14:32:05.928976 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.928959 2577 scope.go:117] "RemoveContainer" containerID="f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296" Jul 14 14:32:05.929248 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:05.929225 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296\": container with ID starting with f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296 not found: ID does not exist" containerID="f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296" Jul 14 14:32:05.929326 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.929259 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296"} err="failed to get container status \"f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296\": rpc error: code = NotFound desc = could not find container \"f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296\": container with ID starting with f586edd527a59992579737e83648add57a844587c08995861156cdc4e8677296 not found: ID does not exist" Jul 14 14:32:05.941126 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.941108 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5978797559-bbpcx"] Jul 14 14:32:05.945403 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:05.945386 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5978797559-bbpcx"] Jul 14 14:32:06.200715 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:06.200688 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3d4e719-a008-4245-af28-8641a5c07f4e" path="/var/lib/kubelet/pods/a3d4e719-a008-4245-af28-8641a5c07f4e/volumes" Jul 14 14:32:07.297338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:07.297305 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:07.397037 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:07.397004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:09.938445 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:09.938373 2577 generic.go:356] "Generic (PLEG): container finished" podID="958e7bf7-ea76-4975-b164-37e36e83cc82" containerID="600479173a91e7811943e168c117cc1305805952f8062bd3a363d5546aa95bed" exitCode=0 Jul 14 14:32:09.938830 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:09.938445 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" event={"ID":"958e7bf7-ea76-4975-b164-37e36e83cc82","Type":"ContainerDied","Data":"600479173a91e7811943e168c117cc1305805952f8062bd3a363d5546aa95bed"} Jul 14 14:32:09.938830 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:09.938785 2577 scope.go:117] "RemoveContainer" containerID="600479173a91e7811943e168c117cc1305805952f8062bd3a363d5546aa95bed" Jul 14 14:32:10.944359 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:10.944324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-nnnb4" event={"ID":"958e7bf7-ea76-4975-b164-37e36e83cc82","Type":"ContainerStarted","Data":"b2ca46454cef866b6b27be6d157c83ec1ade134a972618a5a3275bc91d899a79"} Jul 14 14:32:12.248622 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.248587 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" podUID="24bce890-d4d6-4a0a-a418-340cb3b492e9" containerName="registry" containerID="cri-o://a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3" gracePeriod=30 Jul 14 14:32:12.510056 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.510006 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:32:12.558986 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.558952 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-certificates\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559161 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.558991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-bound-sa-token\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559161 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559016 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-trusted-ca\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559161 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559119 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-installation-pull-secrets\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559161 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559156 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxtxf\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-kube-api-access-qxtxf\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559386 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559205 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-image-registry-private-configuration\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559386 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559245 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559386 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559272 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24bce890-d4d6-4a0a-a418-340cb3b492e9-ca-trust-extracted\") pod \"24bce890-d4d6-4a0a-a418-340cb3b492e9\" (UID: \"24bce890-d4d6-4a0a-a418-340cb3b492e9\") " Jul 14 14:32:12.559606 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559376 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:12.559662 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559609 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-certificates\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.559711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.559680 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:12.561878 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.561848 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:12.562007 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.561918 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:12.562007 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.561927 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-kube-api-access-qxtxf" (OuterVolumeSpecName: "kube-api-access-qxtxf") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "kube-api-access-qxtxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:12.562120 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.562083 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:12.562120 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.562099 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:12.567589 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.567569 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bce890-d4d6-4a0a-a418-340cb3b492e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "24bce890-d4d6-4a0a-a418-340cb3b492e9" (UID: "24bce890-d4d6-4a0a-a418-340cb3b492e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:32:12.660285 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660261 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxtxf\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-kube-api-access-qxtxf\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.660285 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660283 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-image-registry-private-configuration\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.660419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660296 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-registry-tls\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.660419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660305 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24bce890-d4d6-4a0a-a418-340cb3b492e9-ca-trust-extracted\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.660419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660313 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24bce890-d4d6-4a0a-a418-340cb3b492e9-bound-sa-token\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.660419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660321 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24bce890-d4d6-4a0a-a418-340cb3b492e9-trusted-ca\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.660419 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.660329 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24bce890-d4d6-4a0a-a418-340cb3b492e9-installation-pull-secrets\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:12.959651 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.959614 2577 generic.go:356] "Generic (PLEG): container finished" podID="24bce890-d4d6-4a0a-a418-340cb3b492e9" containerID="a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3" exitCode=0 Jul 14 14:32:12.959826 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.959673 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" Jul 14 14:32:12.959826 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.959701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" event={"ID":"24bce890-d4d6-4a0a-a418-340cb3b492e9","Type":"ContainerDied","Data":"a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3"} Jul 14 14:32:12.959826 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.959790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c54c48fb8-pplvc" event={"ID":"24bce890-d4d6-4a0a-a418-340cb3b492e9","Type":"ContainerDied","Data":"ae6c10cf9ff6df164106803e01a5b7a5b1fde5b330664d963fee085bd00c19b6"} Jul 14 14:32:12.959826 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.959816 2577 scope.go:117] "RemoveContainer" containerID="a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3" Jul 14 14:32:12.968939 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.968924 2577 scope.go:117] "RemoveContainer" containerID="a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3" Jul 14 14:32:12.969205 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:12.969186 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3\": container with ID starting with a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3 not found: ID does not exist" containerID="a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3" Jul 14 14:32:12.969249 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.969213 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3"} err="failed to get container status \"a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3\": rpc error: code = NotFound desc = could not find container \"a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3\": container with ID starting with a80ae6d6bf3a857d7c838343e9b36ffd7492759a6f8e5bd924cfaa19b4efabd3 not found: ID does not exist" Jul 14 14:32:12.983015 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.982993 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c54c48fb8-pplvc"] Jul 14 14:32:12.989534 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:12.989511 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c54c48fb8-pplvc"] Jul 14 14:32:14.200390 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:14.200356 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24bce890-d4d6-4a0a-a418-340cb3b492e9" path="/var/lib/kubelet/pods/24bce890-d4d6-4a0a-a418-340cb3b492e9/volumes" Jul 14 14:32:16.437383 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.437350 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5494bc499-8gfns" podUID="efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" containerName="console" containerID="cri-o://76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37" gracePeriod=15 Jul 14 14:32:16.684782 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.684759 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:32:16.786009 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.785937 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-service-ca\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786009 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.785992 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-config\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786188 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786030 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-oauth-serving-cert\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786188 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786089 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-trusted-ca-bundle\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786302 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786212 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9tjj\" (UniqueName: \"kubernetes.io/projected/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-kube-api-access-p9tjj\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786302 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786284 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-oauth-config\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786402 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786309 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-serving-cert\") pod \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\" (UID: \"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0\") " Jul 14 14:32:16.786402 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786354 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:16.786593 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786575 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-service-ca\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.786593 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786576 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-config" (OuterVolumeSpecName: "console-config") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:16.786593 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786583 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:16.786712 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.786596 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:16.788272 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.788248 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-kube-api-access-p9tjj" (OuterVolumeSpecName: "kube-api-access-p9tjj") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "kube-api-access-p9tjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:16.788370 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.788288 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:16.788370 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.788301 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" (UID: "efaba9ca-2f1a-45a3-98b2-456a9dbee9e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:16.887170 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.887148 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.887170 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.887169 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-oauth-serving-cert\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.887287 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.887179 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-trusted-ca-bundle\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.887287 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.887188 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9tjj\" (UniqueName: \"kubernetes.io/projected/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-kube-api-access-p9tjj\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.887287 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.887197 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-oauth-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.887287 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.887206 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0-console-serving-cert\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:16.979842 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.979817 2577 generic.go:356] "Generic (PLEG): container finished" podID="efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" containerID="76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37" exitCode=0 Jul 14 14:32:16.979973 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.979872 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5494bc499-8gfns" Jul 14 14:32:16.979973 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.979884 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bc499-8gfns" event={"ID":"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0","Type":"ContainerDied","Data":"76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37"} Jul 14 14:32:16.979973 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.979929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5494bc499-8gfns" event={"ID":"efaba9ca-2f1a-45a3-98b2-456a9dbee9e0","Type":"ContainerDied","Data":"8a35b9c611fa340871ef6fb470fda25bfbfb1e2a8dddaf1b8c96c02858d87e1d"} Jul 14 14:32:16.979973 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.979949 2577 scope.go:117] "RemoveContainer" containerID="76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37" Jul 14 14:32:16.988126 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.988109 2577 scope.go:117] "RemoveContainer" containerID="76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37" Jul 14 14:32:16.988390 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:16.988372 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37\": container with ID starting with 76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37 not found: ID does not exist" containerID="76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37" Jul 14 14:32:16.988434 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:16.988397 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37"} err="failed to get container status \"76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37\": rpc error: code = NotFound desc = could not find container \"76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37\": container with ID starting with 76251a06ffd3ffbfe06d7449e1110007fb7e8be95905d8f1ddbf90e8d9c55f37 not found: ID does not exist" Jul 14 14:32:17.001298 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:17.001274 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5494bc499-8gfns"] Jul 14 14:32:17.005191 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:17.005172 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5494bc499-8gfns"] Jul 14 14:32:18.204099 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:18.200194 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" path="/var/lib/kubelet/pods/efaba9ca-2f1a-45a3-98b2-456a9dbee9e0/volumes" Jul 14 14:32:22.314438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:22.314392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:22.388048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:22.388004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:25.017960 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:25.017925 2577 generic.go:356] "Generic (PLEG): container finished" podID="6406a951-eecf-4c6e-98fd-98e5b434f4cf" containerID="4186ad1e950683982d66750b5b955946031775b6788c8790aa3bdce7912c1098" exitCode=0 Jul 14 14:32:25.018403 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:25.017997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" event={"ID":"6406a951-eecf-4c6e-98fd-98e5b434f4cf","Type":"ContainerDied","Data":"4186ad1e950683982d66750b5b955946031775b6788c8790aa3bdce7912c1098"} Jul 14 14:32:25.018493 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:25.018426 2577 scope.go:117] "RemoveContainer" containerID="4186ad1e950683982d66750b5b955946031775b6788c8790aa3bdce7912c1098" Jul 14 14:32:26.024847 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:26.024813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bn2gz" event={"ID":"6406a951-eecf-4c6e-98fd-98e5b434f4cf","Type":"ContainerStarted","Data":"b0f5a4680538df3d8e4002a4bb843684ca02c66e715799fc647abe7b4a050ee2"} Jul 14 14:32:27.538953 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:27.538915 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:41.394179 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:41.394128 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:32:41.413001 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:41.412968 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:32:42.108680 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:42.108649 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:32:50.975895 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:50.975854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:51.041166 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:51.041136 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:55.238900 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.238858 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:32:55.239518 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.239268 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="alertmanager" containerID="cri-o://0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b" gracePeriod=120 Jul 14 14:32:55.239518 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.239282 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-web" containerID="cri-o://41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f" gracePeriod=120 Jul 14 14:32:55.239518 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.239363 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-metric" containerID="cri-o://5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261" gracePeriod=120 Jul 14 14:32:55.239518 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.239418 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy" containerID="cri-o://f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef" gracePeriod=120 Jul 14 14:32:55.239518 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.239293 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="config-reloader" containerID="cri-o://62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63" gracePeriod=120 Jul 14 14:32:55.239801 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:55.239552 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="prom-label-proxy" containerID="cri-o://fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7" gracePeriod=120 Jul 14 14:32:56.155985 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.155950 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7" exitCode=0 Jul 14 14:32:56.155985 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.155974 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef" exitCode=0 Jul 14 14:32:56.155985 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.155980 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63" exitCode=0 Jul 14 14:32:56.155985 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.155985 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b" exitCode=0 Jul 14 14:32:56.156277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.156032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7"} Jul 14 14:32:56.156277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.156118 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef"} Jul 14 14:32:56.156277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.156160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63"} Jul 14 14:32:56.156277 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.156196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b"} Jul 14 14:32:56.494842 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.494816 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:56.620808 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620770 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-main-db\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620819 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-cluster-tls-config\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620852 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620879 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-web\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620907 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-tls-assets\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620949 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-metrics-client-ca\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.620979 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-web-config\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621004 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621003 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-out\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621049 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-main-tls\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621075 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-volume\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621132 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621146 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:32:56.621343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621164 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-trusted-ca-bundle\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621302 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t2kz\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-kube-api-access-2t2kz\") pod \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\" (UID: \"ed8aa974-ea3a-46c0-910b-d8b7b1edb457\") " Jul 14 14:32:56.621682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621413 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:56.621682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621536 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:56.621682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621640 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-metrics-client-ca\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.621682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621658 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.621682 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.621673 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-alertmanager-main-db\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.623997 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.623968 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.624256 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.624202 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.624345 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.624271 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:56.624345 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.624288 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-kube-api-access-2t2kz" (OuterVolumeSpecName: "kube-api-access-2t2kz") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "kube-api-access-2t2kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:56.624485 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.624429 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.624550 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.624518 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.624761 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.624734 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-volume" (OuterVolumeSpecName: "config-volume") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.625875 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.625855 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-out" (OuterVolumeSpecName: "config-out") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:32:56.628175 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.628151 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.635749 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.635728 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-web-config" (OuterVolumeSpecName: "web-config") pod "ed8aa974-ea3a-46c0-910b-d8b7b1edb457" (UID: "ed8aa974-ea3a-46c0-910b-d8b7b1edb457"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:56.723020 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.722992 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-cluster-tls-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723020 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723018 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723030 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723039 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-tls-assets\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723047 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-web-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723055 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-out\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723063 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-main-tls\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723071 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-config-volume\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723079 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:56.723172 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:56.723088 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t2kz\" (UniqueName: \"kubernetes.io/projected/ed8aa974-ea3a-46c0-910b-d8b7b1edb457-kube-api-access-2t2kz\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:57.163266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163178 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261" exitCode=0 Jul 14 14:32:57.163266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163201 2577 generic.go:356] "Generic (PLEG): container finished" podID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerID="41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f" exitCode=0 Jul 14 14:32:57.163266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261"} Jul 14 14:32:57.163266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163255 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:57.163537 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f"} Jul 14 14:32:57.163537 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed8aa974-ea3a-46c0-910b-d8b7b1edb457","Type":"ContainerDied","Data":"cdad57fee87f4f44e2036bef0aab19795025aa18d198bde7b081eb49bbebddf3"} Jul 14 14:32:57.163537 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.163367 2577 scope.go:117] "RemoveContainer" containerID="fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7" Jul 14 14:32:57.171332 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.171247 2577 scope.go:117] "RemoveContainer" containerID="5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261" Jul 14 14:32:57.178139 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.178122 2577 scope.go:117] "RemoveContainer" containerID="f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef" Jul 14 14:32:57.184919 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.184888 2577 scope.go:117] "RemoveContainer" containerID="41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f" Jul 14 14:32:57.187742 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.187721 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:32:57.192807 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.192761 2577 scope.go:117] "RemoveContainer" containerID="62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63" Jul 14 14:32:57.194889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.194867 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:32:57.200117 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.200104 2577 scope.go:117] "RemoveContainer" containerID="0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b" Jul 14 14:32:57.206787 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.206770 2577 scope.go:117] "RemoveContainer" containerID="a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284" Jul 14 14:32:57.213283 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.213270 2577 scope.go:117] "RemoveContainer" containerID="fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7" Jul 14 14:32:57.213548 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.213530 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7\": container with ID starting with fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7 not found: ID does not exist" containerID="fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7" Jul 14 14:32:57.213607 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.213555 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7"} err="failed to get container status \"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7\": rpc error: code = NotFound desc = could not find container \"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7\": container with ID starting with fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7 not found: ID does not exist" Jul 14 14:32:57.213607 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.213573 2577 scope.go:117] "RemoveContainer" containerID="5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261" Jul 14 14:32:57.213792 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.213774 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261\": container with ID starting with 5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261 not found: ID does not exist" containerID="5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261" Jul 14 14:32:57.213831 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.213796 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261"} err="failed to get container status \"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261\": rpc error: code = NotFound desc = could not find container \"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261\": container with ID starting with 5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261 not found: ID does not exist" Jul 14 14:32:57.213831 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.213809 2577 scope.go:117] "RemoveContainer" containerID="f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef" Jul 14 14:32:57.214028 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.214009 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef\": container with ID starting with f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef not found: ID does not exist" containerID="f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef" Jul 14 14:32:57.214089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214038 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef"} err="failed to get container status \"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef\": rpc error: code = NotFound desc = could not find container \"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef\": container with ID starting with f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef not found: ID does not exist" Jul 14 14:32:57.214089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214062 2577 scope.go:117] "RemoveContainer" containerID="41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f" Jul 14 14:32:57.214325 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.214308 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f\": container with ID starting with 41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f not found: ID does not exist" containerID="41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f" Jul 14 14:32:57.214363 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214331 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f"} err="failed to get container status \"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f\": rpc error: code = NotFound desc = could not find container \"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f\": container with ID starting with 41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f not found: ID does not exist" Jul 14 14:32:57.214363 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214346 2577 scope.go:117] "RemoveContainer" containerID="62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63" Jul 14 14:32:57.214577 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.214559 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63\": container with ID starting with 62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63 not found: ID does not exist" containerID="62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63" Jul 14 14:32:57.214629 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214586 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63"} err="failed to get container status \"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63\": rpc error: code = NotFound desc = could not find container \"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63\": container with ID starting with 62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63 not found: ID does not exist" Jul 14 14:32:57.214629 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214605 2577 scope.go:117] "RemoveContainer" containerID="0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b" Jul 14 14:32:57.214924 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.214894 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b\": container with ID starting with 0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b not found: ID does not exist" containerID="0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b" Jul 14 14:32:57.215056 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214923 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b"} err="failed to get container status \"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b\": rpc error: code = NotFound desc = could not find container \"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b\": container with ID starting with 0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b not found: ID does not exist" Jul 14 14:32:57.215056 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.214943 2577 scope.go:117] "RemoveContainer" containerID="a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284" Jul 14 14:32:57.215209 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:32:57.215186 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284\": container with ID starting with a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284 not found: ID does not exist" containerID="a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284" Jul 14 14:32:57.215264 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.215215 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284"} err="failed to get container status \"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284\": rpc error: code = NotFound desc = could not find container \"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284\": container with ID starting with a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284 not found: ID does not exist" Jul 14 14:32:57.215264 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.215238 2577 scope.go:117] "RemoveContainer" containerID="fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7" Jul 14 14:32:57.215562 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.215538 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7"} err="failed to get container status \"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7\": rpc error: code = NotFound desc = could not find container \"fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7\": container with ID starting with fa26432f70dbe8bdd5f56160d6519695c15d9fd914b15a690b935ffb15b79db7 not found: ID does not exist" Jul 14 14:32:57.215650 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.215564 2577 scope.go:117] "RemoveContainer" containerID="5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261" Jul 14 14:32:57.215854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.215829 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261"} err="failed to get container status \"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261\": rpc error: code = NotFound desc = could not find container \"5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261\": container with ID starting with 5a4a808588d5ecc75f997d0cc4b8d6f4369cf0a1ff06d756769796fb19f36261 not found: ID does not exist" Jul 14 14:32:57.215854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.215854 2577 scope.go:117] "RemoveContainer" containerID="f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef" Jul 14 14:32:57.216085 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216064 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef"} err="failed to get container status \"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef\": rpc error: code = NotFound desc = could not find container \"f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef\": container with ID starting with f91ed2afef93da3df74c43e2837951bd5b71098f5e79246d1e90d156a989d7ef not found: ID does not exist" Jul 14 14:32:57.216140 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216085 2577 scope.go:117] "RemoveContainer" containerID="41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f" Jul 14 14:32:57.216296 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216278 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f"} err="failed to get container status \"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f\": rpc error: code = NotFound desc = could not find container \"41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f\": container with ID starting with 41ad6e38b6dddf29299e4b5b8e92c179d9db7d8a590451abc779053156681e3f not found: ID does not exist" Jul 14 14:32:57.216336 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216297 2577 scope.go:117] "RemoveContainer" containerID="62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63" Jul 14 14:32:57.216549 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216530 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63"} err="failed to get container status \"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63\": rpc error: code = NotFound desc = could not find container \"62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63\": container with ID starting with 62346ecb79b357531b521f36e6cd27685583ee6cdcf8275a81840a083b3d9a63 not found: ID does not exist" Jul 14 14:32:57.216628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216551 2577 scope.go:117] "RemoveContainer" containerID="0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b" Jul 14 14:32:57.216780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216761 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b"} err="failed to get container status \"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b\": rpc error: code = NotFound desc = could not find container \"0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b\": container with ID starting with 0b7742b4b88c528c4dc814bdc55b3fed0e242aa755123c7727ee5e610b0cea8b not found: ID does not exist" Jul 14 14:32:57.216828 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216782 2577 scope.go:117] "RemoveContainer" containerID="a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284" Jul 14 14:32:57.216988 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:57.216969 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284"} err="failed to get container status \"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284\": rpc error: code = NotFound desc = could not find container \"a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284\": container with ID starting with a2b7b5ac90ccdfa9972263fd40c9a03dec88e7822324b3a361acc9e9db3a0284 not found: ID does not exist" Jul 14 14:32:58.199192 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:58.199161 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" path="/var/lib/kubelet/pods/ed8aa974-ea3a-46c0-910b-d8b7b1edb457/volumes" Jul 14 14:32:59.481379 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.481336 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:32:59.481836 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.481766 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="prometheus" containerID="cri-o://e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" gracePeriod=600 Jul 14 14:32:59.482059 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.482022 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy" containerID="cri-o://74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" gracePeriod=600 Jul 14 14:32:59.482152 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.482078 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="thanos-sidecar" containerID="cri-o://7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" gracePeriod=600 Jul 14 14:32:59.482152 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.482094 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" gracePeriod=600 Jul 14 14:32:59.482152 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.482121 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="config-reloader" containerID="cri-o://827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" gracePeriod=600 Jul 14 14:32:59.482309 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.482095 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-web" containerID="cri-o://4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" gracePeriod=600 Jul 14 14:32:59.736706 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.736642 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:32:59.846556 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846518 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-grpc-tls\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846575 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-serving-certs-ca-bundle\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846593 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-kubelet-serving-ca-bundle\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846612 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846629 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-tls\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-metrics-client-certs\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846667 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-config\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846682 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-0\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.846721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846711 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-tls-assets\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846744 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-web-config\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846787 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-db\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846812 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-kube-rbac-proxy\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846835 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-trusted-ca-bundle\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbz2x\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-kube-api-access-vbz2x\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846875 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-config-out\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846906 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-thanos-prometheus-http-client-file\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-1\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846968 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-2\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.846994 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-metrics-client-ca\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.847036 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"935653aa-31cb-4b28-a51b-739507ff9011\" (UID: \"935653aa-31cb-4b28-a51b-739507ff9011\") " Jul 14 14:32:59.847134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.847058 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.847738 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.847308 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.847738 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.847345 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.849115 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.849081 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.849592 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.849561 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.849692 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.849665 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.849757 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.849684 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.850321 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850001 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.850321 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850039 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.850321 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850095 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-config" (OuterVolumeSpecName: "config") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.850321 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850130 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:32:59.850321 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850226 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.850579 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850507 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:59.850579 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:32:59.850579 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.850531 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.851025 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.851005 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.851713 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.851688 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.851792 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.851737 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.851877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.851850 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-config-out" (OuterVolumeSpecName: "config-out") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:32:59.852195 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.852177 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-kube-api-access-vbz2x" (OuterVolumeSpecName: "kube-api-access-vbz2x") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "kube-api-access-vbz2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:32:59.861415 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.861393 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-web-config" (OuterVolumeSpecName: "web-config") pod "935653aa-31cb-4b28-a51b-739507ff9011" (UID: "935653aa-31cb-4b28-a51b-739507ff9011"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:32:59.948173 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948133 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-db\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948173 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948166 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-kube-rbac-proxy\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948173 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948177 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948188 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbz2x\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-kube-api-access-vbz2x\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948197 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935653aa-31cb-4b28-a51b-739507ff9011-config-out\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948206 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948214 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948224 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948232 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-metrics-client-ca\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948241 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948250 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-grpc-tls\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948259 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948267 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948276 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948283 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-secret-metrics-client-certs\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948292 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948299 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935653aa-31cb-4b28-a51b-739507ff9011-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948309 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935653aa-31cb-4b28-a51b-739507ff9011-tls-assets\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:32:59.948395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:32:59.948340 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935653aa-31cb-4b28-a51b-739507ff9011-web-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:00.178857 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178829 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" exitCode=0 Jul 14 14:33:00.178857 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178854 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" exitCode=0 Jul 14 14:33:00.178857 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178861 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" exitCode=0 Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178868 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" exitCode=0 Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178873 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" exitCode=0 Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178882 2577 generic.go:356] "Generic (PLEG): container finished" podID="935653aa-31cb-4b28-a51b-739507ff9011" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" exitCode=0 Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178906 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178997 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.178982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.179101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} Jul 14 14:33:00.179153 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.179148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} Jul 14 14:33:00.179573 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.179189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} Jul 14 14:33:00.179573 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.179230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} Jul 14 14:33:00.179573 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.179270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935653aa-31cb-4b28-a51b-739507ff9011","Type":"ContainerDied","Data":"5c4a74e84eb62549b9591c1819a7936185499997e646757cadc99a1b636e036f"} Jul 14 14:33:00.186633 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.186616 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.193734 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.193716 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.200208 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.200192 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.203813 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.203793 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:33:00.207676 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.207657 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.208721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.208705 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:33:00.214316 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.214301 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.220821 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.220807 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.227309 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.227292 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.227647 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.227629 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.227699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.227656 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} err="failed to get container status \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" Jul 14 14:33:00.227699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.227673 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.227904 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.227884 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.227943 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.227911 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} err="failed to get container status \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" Jul 14 14:33:00.227943 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.227928 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.228159 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.228143 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.228200 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228163 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} err="failed to get container status \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" Jul 14 14:33:00.228200 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228177 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.228389 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.228372 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.228429 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228395 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} err="failed to get container status \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" Jul 14 14:33:00.228429 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228410 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.228632 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.228615 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.228673 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228635 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} err="failed to get container status \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" Jul 14 14:33:00.228673 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228647 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.228882 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.228864 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.228931 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228887 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} err="failed to get container status \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" Jul 14 14:33:00.228931 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.228900 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.229101 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:00.229086 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.229152 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229103 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} err="failed to get container status \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" Jul 14 14:33:00.229152 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229115 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.229302 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229287 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} err="failed to get container status \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" Jul 14 14:33:00.229342 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229303 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.229594 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229552 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} err="failed to get container status \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" Jul 14 14:33:00.229594 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229588 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.229810 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229794 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} err="failed to get container status \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" Jul 14 14:33:00.229850 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229811 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.230002 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.229985 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} err="failed to get container status \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" Jul 14 14:33:00.230040 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230003 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.230228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230213 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} err="failed to get container status \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" Jul 14 14:33:00.230272 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230228 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.230438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230415 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} err="failed to get container status \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" Jul 14 14:33:00.230438 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230438 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.230683 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230665 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} err="failed to get container status \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" Jul 14 14:33:00.230683 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230682 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.230915 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230898 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} err="failed to get container status \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" Jul 14 14:33:00.230963 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.230916 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.231109 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231081 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} err="failed to get container status \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" Jul 14 14:33:00.231109 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231101 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.231280 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231262 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} err="failed to get container status \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" Jul 14 14:33:00.231330 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231282 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.231520 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231447 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} err="failed to get container status \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" Jul 14 14:33:00.231520 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231486 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.231716 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231700 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} err="failed to get container status \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" Jul 14 14:33:00.231763 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231717 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.231890 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231871 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} err="failed to get container status \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" Jul 14 14:33:00.231957 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.231892 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.232079 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232064 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} err="failed to get container status \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" Jul 14 14:33:00.232121 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232080 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.232248 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232225 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} err="failed to get container status \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" Jul 14 14:33:00.232248 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232240 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.232476 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232439 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} err="failed to get container status \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" Jul 14 14:33:00.232519 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232479 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.232711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232694 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} err="failed to get container status \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" Jul 14 14:33:00.232753 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232711 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.232914 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232897 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} err="failed to get container status \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" Jul 14 14:33:00.232950 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.232915 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.233113 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233092 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} err="failed to get container status \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" Jul 14 14:33:00.233156 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233114 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.233327 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233309 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} err="failed to get container status \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" Jul 14 14:33:00.233393 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233329 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.233571 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233552 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} err="failed to get container status \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" Jul 14 14:33:00.233631 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233572 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.233785 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233768 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} err="failed to get container status \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" Jul 14 14:33:00.233854 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233786 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.234006 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.233988 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} err="failed to get container status \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" Jul 14 14:33:00.234069 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234007 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.234212 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234195 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} err="failed to get container status \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" Jul 14 14:33:00.234271 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234213 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.234439 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234421 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} err="failed to get container status \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" Jul 14 14:33:00.234616 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234440 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.235283 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234832 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} err="failed to get container status \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" Jul 14 14:33:00.235283 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.234858 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.235283 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.235156 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} err="failed to get container status \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" Jul 14 14:33:00.235283 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.235176 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.235544 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.235492 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} err="failed to get container status \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" Jul 14 14:33:00.235544 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.235513 2577 scope.go:117] "RemoveContainer" containerID="0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b" Jul 14 14:33:00.235792 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.235773 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b"} err="failed to get container status \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": rpc error: code = NotFound desc = could not find container \"0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b\": container with ID starting with 0de7e21eec86a223c6b2187c4a1a62e9d592dbc32a5e7f9435ec63c0e311be5b not found: ID does not exist" Jul 14 14:33:00.235875 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.235794 2577 scope.go:117] "RemoveContainer" containerID="74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b" Jul 14 14:33:00.236051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236030 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b"} err="failed to get container status \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": rpc error: code = NotFound desc = could not find container \"74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b\": container with ID starting with 74ac2f8212c1f53e4d7883c806a4244e4499d704d61f980738b8c0d92664d10b not found: ID does not exist" Jul 14 14:33:00.236096 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236055 2577 scope.go:117] "RemoveContainer" containerID="4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0" Jul 14 14:33:00.236264 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236246 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0"} err="failed to get container status \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": rpc error: code = NotFound desc = could not find container \"4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0\": container with ID starting with 4e862f6503e02c687dac0366d044129ced094ad9f516270b4680c0d7054ad3e0 not found: ID does not exist" Jul 14 14:33:00.236309 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236266 2577 scope.go:117] "RemoveContainer" containerID="7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc" Jul 14 14:33:00.236484 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236448 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc"} err="failed to get container status \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": rpc error: code = NotFound desc = could not find container \"7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc\": container with ID starting with 7824b2077b095c28476731fe1675c636bc1f87e2e476e08b19323bd845cf5ccc not found: ID does not exist" Jul 14 14:33:00.236528 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236485 2577 scope.go:117] "RemoveContainer" containerID="827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038" Jul 14 14:33:00.236564 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236534 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:33:00.236731 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236711 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038"} err="failed to get container status \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": rpc error: code = NotFound desc = could not find container \"827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038\": container with ID starting with 827729e9c7234f82ac266cab5c1edd62044578d7ded13f11f6c76c4c1dc83038 not found: ID does not exist" Jul 14 14:33:00.236782 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236734 2577 scope.go:117] "RemoveContainer" containerID="e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70" Jul 14 14:33:00.236858 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236844 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="init-config-reloader" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236859 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="init-config-reloader" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236869 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="prom-label-proxy" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236875 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="prom-label-proxy" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236885 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236890 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236899 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d4e719-a008-4245-af28-8641a5c07f4e" containerName="console" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236904 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d4e719-a008-4245-af28-8641a5c07f4e" containerName="console" Jul 14 14:33:00.236907 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236910 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="prometheus" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236916 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="prometheus" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236928 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="thanos-sidecar" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236933 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="thanos-sidecar" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236942 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-metric" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236947 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-metric" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236954 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-web" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236958 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-web" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236967 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="config-reloader" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236972 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="config-reloader" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236978 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="config-reloader" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236983 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="config-reloader" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236989 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-thanos" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236994 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-thanos" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237000 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-web" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237006 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-web" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237011 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="init-config-reloader" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237016 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="init-config-reloader" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237022 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.236949 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70"} err="failed to get container status \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": rpc error: code = NotFound desc = could not find container \"e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70\": container with ID starting with e21651e8b3fff94a67f12420edd58cdd4abeb8d8adaddd4336f1c6af096e0e70 not found: ID does not exist" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237044 2577 scope.go:117] "RemoveContainer" containerID="968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237027 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237114 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" containerName="console" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237126 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" containerName="console" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237136 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="alertmanager" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237145 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="alertmanager" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237160 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bce890-d4d6-4a0a-a418-340cb3b492e9" containerName="registry" Jul 14 14:33:00.237241 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237169 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bce890-d4d6-4a0a-a418-340cb3b492e9" containerName="registry" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237252 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a"} err="failed to get container status \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": rpc error: code = NotFound desc = could not find container \"968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a\": container with ID starting with 968447cb656ff18a6fb267ea8d2a3fdfd3c72f29c077d18fa063f409bf9c570a not found: ID does not exist" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237260 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237274 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bce890-d4d6-4a0a-a418-340cb3b492e9" containerName="registry" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237281 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-web" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237289 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="config-reloader" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237295 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="prom-label-proxy" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237304 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d4e719-a008-4245-af28-8641a5c07f4e" containerName="console" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237309 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-web" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237315 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237320 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="config-reloader" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237325 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="alertmanager" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237329 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="kube-rbac-proxy-thanos" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237334 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="thanos-sidecar" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237339 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8aa974-ea3a-46c0-910b-d8b7b1edb457" containerName="kube-rbac-proxy-metric" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237344 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="efaba9ca-2f1a-45a3-98b2-456a9dbee9e0" containerName="console" Jul 14 14:33:00.238118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.237350 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="935653aa-31cb-4b28-a51b-739507ff9011" containerName="prometheus" Jul 14 14:33:00.240756 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.240739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.243741 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.243721 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 14:33:00.243951 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.243929 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sxglt\"" Jul 14 14:33:00.244030 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.243951 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 14:33:00.244030 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.244014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ass7b4hpeinin\"" Jul 14 14:33:00.244118 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.244062 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 14:33:00.244566 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.244550 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 14:33:00.244611 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.244569 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 14:33:00.244648 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.244558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 14:33:00.244691 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.244676 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 14:33:00.245145 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.245131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 14:33:00.245802 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.245667 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 14:33:00.245802 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.245672 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 14:33:00.245802 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.245711 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 14:33:00.245802 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.245740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 14:33:00.246015 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.245813 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 14:33:00.249013 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.248991 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 14:33:00.251127 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.251107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 14:33:00.260567 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.260546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:33:00.351651 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.351651 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.351889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.351889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.351889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.351889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.351889 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8221703e-5915-4f4a-bc54-9c4572d368a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.351957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352089 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmjsq\" (UniqueName: \"kubernetes.io/projected/8221703e-5915-4f4a-bc54-9c4572d368a8-kube-api-access-qmjsq\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-config\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8221703e-5915-4f4a-bc54-9c4572d368a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.352266 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.352265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453236 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453236 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453236 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453535 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8221703e-5915-4f4a-bc54-9c4572d368a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453535 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453535 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453535 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453535 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8221703e-5915-4f4a-bc54-9c4572d368a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.453780 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmjsq\" (UniqueName: \"kubernetes.io/projected/8221703e-5915-4f4a-bc54-9c4572d368a8-kube-api-access-qmjsq\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-config\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.453982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.454010 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454148 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.454058 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.454616 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.454592 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.456227 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.456199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8221703e-5915-4f4a-bc54-9c4572d368a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.456341 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.456283 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.456341 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.456325 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.456656 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.456632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8221703e-5915-4f4a-bc54-9c4572d368a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.456750 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.456714 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.457219 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.457189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-config\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.457310 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.457219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.457902 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.457555 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.457902 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.457767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.457902 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.457858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.458099 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.457992 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8221703e-5915-4f4a-bc54-9c4572d368a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.458572 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.458547 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.458784 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.458769 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.458853 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.458838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.459291 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.459275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8221703e-5915-4f4a-bc54-9c4572d368a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.465574 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.465556 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmjsq\" (UniqueName: \"kubernetes.io/projected/8221703e-5915-4f4a-bc54-9c4572d368a8-kube-api-access-qmjsq\") pod \"prometheus-k8s-0\" (UID: \"8221703e-5915-4f4a-bc54-9c4572d368a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.551932 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.551907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:00.691173 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:00.691061 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 14:33:00.700585 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:33:00.696566 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8221703e_5915_4f4a_bc54_9c4572d368a8.slice/crio-69a31daf56acf59aa37da6f77739b7a4e06f4d7f3b48f26108a382ec82dd4489 WatchSource:0}: Error finding container 69a31daf56acf59aa37da6f77739b7a4e06f4d7f3b48f26108a382ec82dd4489: Status 404 returned error can't find the container with id 69a31daf56acf59aa37da6f77739b7a4e06f4d7f3b48f26108a382ec82dd4489 Jul 14 14:33:01.184546 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:01.184511 2577 generic.go:356] "Generic (PLEG): container finished" podID="8221703e-5915-4f4a-bc54-9c4572d368a8" containerID="51a9438049877946ddc15cbd7c9ee397651033a596dfe9658936be230582f11c" exitCode=0 Jul 14 14:33:01.184681 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:01.184599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerDied","Data":"51a9438049877946ddc15cbd7c9ee397651033a596dfe9658936be230582f11c"} Jul 14 14:33:01.184747 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:01.184711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"69a31daf56acf59aa37da6f77739b7a4e06f4d7f3b48f26108a382ec82dd4489"} Jul 14 14:33:02.193587 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.193546 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"98f346d8e407a3eb651d62b68c874ba288d0902a45ae90071e4ee8a5142d1914"} Jul 14 14:33:02.193996 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.193614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"3726c7b163d4c721b3de4c907a12c14c8148ef9cee96c8eb930246486c379c5d"} Jul 14 14:33:02.193996 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.193641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"ae81b52d4ad4802e618109b0f2da67901caaf437a9dcaea5bf49747ddc525d3e"} Jul 14 14:33:02.193996 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.193668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"9311edd1c02155cd4162ddc3c9ff6008c6de453243e1ed94adfc759ded9962f0"} Jul 14 14:33:02.193996 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.193694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"4e5899fecb73c4e2a4526def0fbc1bd938b1aeae39fe794998b5a4d6277a2e17"} Jul 14 14:33:02.193996 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.193718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8221703e-5915-4f4a-bc54-9c4572d368a8","Type":"ContainerStarted","Data":"677fcdee4e2bf19dbc00d6ca44152605fcb41b230ea10ac5eb4996e06010b65f"} Jul 14 14:33:02.199581 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.199556 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="935653aa-31cb-4b28-a51b-739507ff9011" path="/var/lib/kubelet/pods/935653aa-31cb-4b28-a51b-739507ff9011/volumes" Jul 14 14:33:02.230547 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.230449 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.212002066 podStartE2EDuration="2.230430747s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.428681ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:33:02.228830702 +0000 UTC m=+204.536476167" watchObservedRunningTime="2026-07-14 14:33:02.230430747 +0000 UTC m=+204.538076190" Jul 14 14:33:02.852394 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.852362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:02.952634 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:02.952606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:05.552538 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:05.552507 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:33:07.324663 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:07.324630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:07.425418 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:07.425390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:14.981806 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:14.981762 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:15.045964 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:15.045936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:25.772753 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:25.772720 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c89fbd59-bbfwz"] Jul 14 14:33:25.883065 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:25.883032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:25.984322 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:25.984296 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:26.084059 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:26.083986 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:41.416280 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:41.416243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:41.467816 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:41.467781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:50.792851 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:50.792784 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c89fbd59-bbfwz" podUID="34029023-31de-4aad-9be3-34225e2d12ba" containerName="console" containerID="cri-o://88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66" gracePeriod=15 Jul 14 14:33:51.032740 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.032714 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:33:51.109411 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109348 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-console-config\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109411 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109395 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-service-ca\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109442 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljhrg\" (UniqueName: \"kubernetes.io/projected/34029023-31de-4aad-9be3-34225e2d12ba-kube-api-access-ljhrg\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109489 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-oauth-config\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109512 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-serving-cert\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109549 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-oauth-serving-cert\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109573 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-trusted-ca-bundle\") pod \"34029023-31de-4aad-9be3-34225e2d12ba\" (UID: \"34029023-31de-4aad-9be3-34225e2d12ba\") " Jul 14 14:33:51.109839 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109772 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-console-config" (OuterVolumeSpecName: "console-config") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:51.109894 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.109862 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:51.110037 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.110011 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:51.110140 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.110119 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:51.111650 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.111627 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:51.112033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.112003 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:51.112033 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.112015 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34029023-31de-4aad-9be3-34225e2d12ba-kube-api-access-ljhrg" (OuterVolumeSpecName: "kube-api-access-ljhrg") pod "34029023-31de-4aad-9be3-34225e2d12ba" (UID: "34029023-31de-4aad-9be3-34225e2d12ba"). InnerVolumeSpecName "kube-api-access-ljhrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:33:51.210244 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210212 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-console-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.210244 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210241 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-service-ca\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.210244 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210250 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljhrg\" (UniqueName: \"kubernetes.io/projected/34029023-31de-4aad-9be3-34225e2d12ba-kube-api-access-ljhrg\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.210395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210258 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-oauth-config\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.210395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210267 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34029023-31de-4aad-9be3-34225e2d12ba-console-serving-cert\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.210395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210275 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-oauth-serving-cert\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.210395 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.210283 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34029023-31de-4aad-9be3-34225e2d12ba-trusted-ca-bundle\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:33:51.394047 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.393994 2577 generic.go:356] "Generic (PLEG): container finished" podID="34029023-31de-4aad-9be3-34225e2d12ba" containerID="88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66" exitCode=0 Jul 14 14:33:51.394047 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.394033 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c89fbd59-bbfwz" Jul 14 14:33:51.394163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.394077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c89fbd59-bbfwz" event={"ID":"34029023-31de-4aad-9be3-34225e2d12ba","Type":"ContainerDied","Data":"88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66"} Jul 14 14:33:51.394163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.394122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c89fbd59-bbfwz" event={"ID":"34029023-31de-4aad-9be3-34225e2d12ba","Type":"ContainerDied","Data":"c41c6aa24d521c459e5959cfbf316ec0477558eef9d69259de24d0ec4099d531"} Jul 14 14:33:51.394163 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.394142 2577 scope.go:117] "RemoveContainer" containerID="88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66" Jul 14 14:33:51.402533 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.402516 2577 scope.go:117] "RemoveContainer" containerID="88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66" Jul 14 14:33:51.402792 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:33:51.402775 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66\": container with ID starting with 88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66 not found: ID does not exist" containerID="88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66" Jul 14 14:33:51.402837 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.402801 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66"} err="failed to get container status \"88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66\": rpc error: code = NotFound desc = could not find container \"88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66\": container with ID starting with 88dba01961c54fddda85a49afa5bc012105b804af172f08ea95f36a459323a66 not found: ID does not exist" Jul 14 14:33:51.415912 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.415891 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c89fbd59-bbfwz"] Jul 14 14:33:51.423040 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:51.423018 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c89fbd59-bbfwz"] Jul 14 14:33:52.202651 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:52.201107 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34029023-31de-4aad-9be3-34225e2d12ba" path="/var/lib/kubelet/pods/34029023-31de-4aad-9be3-34225e2d12ba/volumes" Jul 14 14:33:55.789604 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:33:55.789554 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:00.552282 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:00.552248 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:34:00.567437 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:00.567411 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:34:01.448583 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:01.448555 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 14:34:13.767223 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:13.767181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:38.119852 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:38.119825 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:34:38.122466 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:38.122429 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:34:38.125385 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:38.125366 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 14:34:50.054782 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:50.054747 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:50.152194 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:50.152150 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:50.396596 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:50.396532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:50.498597 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:50.498557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:51.327516 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:34:51.327481 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:18.970650 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:18.970611 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:21.857789 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:21.857754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:25.358260 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:25.358226 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:25.588034 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:25.587997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:25.922736 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:25.922696 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:26.103996 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:26.103965 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:26.317002 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:26.316973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:26.451366 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:26.451334 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:27.331944 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:27.331913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:27.430331 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:27.430303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:43.711217 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:43.711182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:43.838142 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:35:43.838104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:34.576374 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:34.576338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:34.671097 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:34.671060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:34.826158 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:34.826122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:35.109439 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:35.109409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:35.208549 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:35.208520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:35.399688 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:35.399618 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:35.502808 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:36:35.502782 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:04.523990 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.523913 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86485b4bc6-9h68g"] Jul 14 14:37:04.524428 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.524187 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34029023-31de-4aad-9be3-34225e2d12ba" containerName="console" Jul 14 14:37:04.524428 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.524199 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="34029023-31de-4aad-9be3-34225e2d12ba" containerName="console" Jul 14 14:37:04.524428 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.524261 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="34029023-31de-4aad-9be3-34225e2d12ba" containerName="console" Jul 14 14:37:04.527079 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.527063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.529576 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.529555 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qhv7n\"" Jul 14 14:37:04.529916 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.529897 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 14:37:04.530653 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.530634 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 14:37:04.530653 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.530644 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 14:37:04.530809 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.530707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 14:37:04.530809 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.530772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 14:37:04.530809 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.530782 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 14:37:04.531048 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.531032 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 14:37:04.538338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.538321 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 14:37:04.542280 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.542259 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86485b4bc6-9h68g"] Jul 14 14:37:04.607726 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.607703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:04.611667 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-oauth-serving-cert\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.611754 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-trusted-ca-bundle\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.611754 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptrdp\" (UniqueName: \"kubernetes.io/projected/fa551b22-7eca-4ce4-880d-c3b5038031ee-kube-api-access-ptrdp\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.611842 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-service-ca\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.611842 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-oauth-config\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.611842 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-config\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.611946 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.611860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-serving-cert\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713140 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-config\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713253 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-serving-cert\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713253 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-oauth-serving-cert\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713253 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-trusted-ca-bundle\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713253 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptrdp\" (UniqueName: \"kubernetes.io/projected/fa551b22-7eca-4ce4-880d-c3b5038031ee-kube-api-access-ptrdp\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713253 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-service-ca\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713512 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-oauth-config\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.713877 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.713854 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-config\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.714047 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.714024 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-oauth-serving-cert\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.714121 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.714097 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-service-ca\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.714121 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.714106 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa551b22-7eca-4ce4-880d-c3b5038031ee-trusted-ca-bundle\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.715812 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.715789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-oauth-config\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.715812 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.715801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa551b22-7eca-4ce4-880d-c3b5038031ee-console-serving-cert\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.723755 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.723732 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptrdp\" (UniqueName: \"kubernetes.io/projected/fa551b22-7eca-4ce4-880d-c3b5038031ee-kube-api-access-ptrdp\") pod \"console-86485b4bc6-9h68g\" (UID: \"fa551b22-7eca-4ce4-880d-c3b5038031ee\") " pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.836899 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.836827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:04.967343 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:04.967247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86485b4bc6-9h68g"] Jul 14 14:37:04.969484 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:37:04.969443 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa551b22_7eca_4ce4_880d_c3b5038031ee.slice/crio-50383a3097b39ebe16f46894a58c45f1e833ea8ba2414f023c7231f403d3b7c2 WatchSource:0}: Error finding container 50383a3097b39ebe16f46894a58c45f1e833ea8ba2414f023c7231f403d3b7c2: Status 404 returned error can't find the container with id 50383a3097b39ebe16f46894a58c45f1e833ea8ba2414f023c7231f403d3b7c2 Jul 14 14:37:05.116711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:05.116634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86485b4bc6-9h68g" event={"ID":"fa551b22-7eca-4ce4-880d-c3b5038031ee","Type":"ContainerStarted","Data":"cbde0ca4da23d97ba94fc5e0361c8a0b8f91efe3b55a4c1fb5719f21132abdd0"} Jul 14 14:37:05.116711 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:05.116679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86485b4bc6-9h68g" event={"ID":"fa551b22-7eca-4ce4-880d-c3b5038031ee","Type":"ContainerStarted","Data":"50383a3097b39ebe16f46894a58c45f1e833ea8ba2414f023c7231f403d3b7c2"} Jul 14 14:37:05.139366 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:05.139318 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86485b4bc6-9h68g" podStartSLOduration=1.139304903 podStartE2EDuration="1.139304903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:37:05.137516472 +0000 UTC m=+447.445161922" watchObservedRunningTime="2026-07-14 14:37:05.139304903 +0000 UTC m=+447.446950353" Jul 14 14:37:14.837912 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:14.837877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:14.838338 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:14.837962 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:14.842752 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:14.842725 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:15.159935 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.159860 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86485b4bc6-9h68g" Jul 14 14:37:15.325037 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.325003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:15.426067 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.426036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:15.510936 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.510909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:15.711184 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.711116 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gdpqw/must-gather-s6fhm"] Jul 14 14:37:15.714525 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.714508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:15.717292 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.717266 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdpqw\"/\"openshift-service-ca.crt\"" Jul 14 14:37:15.717401 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.717341 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdpqw\"/\"kube-root-ca.crt\"" Jul 14 14:37:15.727496 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.727472 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdpqw/must-gather-s6fhm"] Jul 14 14:37:15.730224 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.730199 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:15.789116 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.789094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/446b2d5d-858d-4b67-a55b-1a3388f5fd77-must-gather-output\") pod \"must-gather-s6fhm\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:15.789206 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.789129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2njm\" (UniqueName: \"kubernetes.io/projected/446b2d5d-858d-4b67-a55b-1a3388f5fd77-kube-api-access-m2njm\") pod \"must-gather-s6fhm\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:15.829351 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.829304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:15.890490 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.890447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/446b2d5d-858d-4b67-a55b-1a3388f5fd77-must-gather-output\") pod \"must-gather-s6fhm\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:15.890825 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.890515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2njm\" (UniqueName: \"kubernetes.io/projected/446b2d5d-858d-4b67-a55b-1a3388f5fd77-kube-api-access-m2njm\") pod \"must-gather-s6fhm\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:15.890825 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.890744 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/446b2d5d-858d-4b67-a55b-1a3388f5fd77-must-gather-output\") pod \"must-gather-s6fhm\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:15.898981 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:15.898959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2njm\" (UniqueName: \"kubernetes.io/projected/446b2d5d-858d-4b67-a55b-1a3388f5fd77-kube-api-access-m2njm\") pod \"must-gather-s6fhm\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:16.042501 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:16.042424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:16.168435 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:16.168413 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdpqw/must-gather-s6fhm"] Jul 14 14:37:16.171180 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:37:16.171152 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod446b2d5d_858d_4b67_a55b_1a3388f5fd77.slice/crio-27f1c4f61e9288fc96c82961af1e7b12f050cb0bb82f73452b93226c879be078 WatchSource:0}: Error finding container 27f1c4f61e9288fc96c82961af1e7b12f050cb0bb82f73452b93226c879be078: Status 404 returned error can't find the container with id 27f1c4f61e9288fc96c82961af1e7b12f050cb0bb82f73452b93226c879be078 Jul 14 14:37:16.173134 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:16.173113 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:37:17.169224 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:17.169159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" event={"ID":"446b2d5d-858d-4b67-a55b-1a3388f5fd77","Type":"ContainerStarted","Data":"27f1c4f61e9288fc96c82961af1e7b12f050cb0bb82f73452b93226c879be078"} Jul 14 14:37:23.198421 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:23.198382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" event={"ID":"446b2d5d-858d-4b67-a55b-1a3388f5fd77","Type":"ContainerStarted","Data":"683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640"} Jul 14 14:37:23.198797 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:23.198434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" event={"ID":"446b2d5d-858d-4b67-a55b-1a3388f5fd77","Type":"ContainerStarted","Data":"cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f"} Jul 14 14:37:23.215156 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:23.215091 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" podStartSLOduration=1.981272253 podStartE2EDuration="8.215070174s" totalImagesPullingTime="6.233797921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:37:23.214242839 +0000 UTC m=+465.521888290" watchObservedRunningTime="2026-07-14 14:37:23.215070174 +0000 UTC m=+465.522715627" Jul 14 14:37:35.254359 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:35.254292 2577 generic.go:356] "Generic (PLEG): container finished" podID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerID="cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f" exitCode=0 Jul 14 14:37:35.254359 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:35.254345 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" event={"ID":"446b2d5d-858d-4b67-a55b-1a3388f5fd77","Type":"ContainerDied","Data":"cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f"} Jul 14 14:37:35.254825 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:35.254684 2577 scope.go:117] "RemoveContainer" containerID="cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f" Jul 14 14:37:36.060578 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.060550 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gdpqw_must-gather-s6fhm_446b2d5d-858d-4b67-a55b-1a3388f5fd77/gather/0.log" Jul 14 14:37:36.423296 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.423205 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:36.542824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.542791 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ccn9n/must-gather-nq2hd"] Jul 14 14:37:36.545977 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.545961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.548342 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.548319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ccn9n\"/\"kube-root-ca.crt\"" Jul 14 14:37:36.548493 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.548323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ccn9n\"/\"default-dockercfg-v2ks4\"" Jul 14 14:37:36.548493 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.548419 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ccn9n\"/\"openshift-service-ca.crt\"" Jul 14 14:37:36.557187 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.557167 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccn9n/must-gather-nq2hd"] Jul 14 14:37:36.561578 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.561557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:36.621966 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.621933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:36.681769 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.681744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4ce3f724-9312-40b6-994a-d673eb87f6b6-must-gather-output\") pod \"must-gather-nq2hd\" (UID: \"4ce3f724-9312-40b6-994a-d673eb87f6b6\") " pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.681921 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.681791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2xg\" (UniqueName: \"kubernetes.io/projected/4ce3f724-9312-40b6-994a-d673eb87f6b6-kube-api-access-ht2xg\") pod \"must-gather-nq2hd\" (UID: \"4ce3f724-9312-40b6-994a-d673eb87f6b6\") " pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.783195 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.783154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2xg\" (UniqueName: \"kubernetes.io/projected/4ce3f724-9312-40b6-994a-d673eb87f6b6-kube-api-access-ht2xg\") pod \"must-gather-nq2hd\" (UID: \"4ce3f724-9312-40b6-994a-d673eb87f6b6\") " pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.783376 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.783236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4ce3f724-9312-40b6-994a-d673eb87f6b6-must-gather-output\") pod \"must-gather-nq2hd\" (UID: \"4ce3f724-9312-40b6-994a-d673eb87f6b6\") " pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.783608 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.783588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4ce3f724-9312-40b6-994a-d673eb87f6b6-must-gather-output\") pod \"must-gather-nq2hd\" (UID: \"4ce3f724-9312-40b6-994a-d673eb87f6b6\") " pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.791142 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.791119 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2xg\" (UniqueName: \"kubernetes.io/projected/4ce3f724-9312-40b6-994a-d673eb87f6b6-kube-api-access-ht2xg\") pod \"must-gather-nq2hd\" (UID: \"4ce3f724-9312-40b6-994a-d673eb87f6b6\") " pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.855297 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.855268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccn9n/must-gather-nq2hd" Jul 14 14:37:36.982675 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:36.982640 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccn9n/must-gather-nq2hd"] Jul 14 14:37:36.985419 ip-10-0-134-71 kubenswrapper[2577]: W0714 14:37:36.985389 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ce3f724_9312_40b6_994a_d673eb87f6b6.slice/crio-a4a93ea6591287eaf503a12c970e7ff62d026e906fea733c15e910abb78fadd3 WatchSource:0}: Error finding container a4a93ea6591287eaf503a12c970e7ff62d026e906fea733c15e910abb78fadd3: Status 404 returned error can't find the container with id a4a93ea6591287eaf503a12c970e7ff62d026e906fea733c15e910abb78fadd3 Jul 14 14:37:37.263585 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:37.263499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccn9n/must-gather-nq2hd" event={"ID":"4ce3f724-9312-40b6-994a-d673eb87f6b6","Type":"ContainerStarted","Data":"a4a93ea6591287eaf503a12c970e7ff62d026e906fea733c15e910abb78fadd3"} Jul 14 14:37:38.275021 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:38.274985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccn9n/must-gather-nq2hd" event={"ID":"4ce3f724-9312-40b6-994a-d673eb87f6b6","Type":"ContainerStarted","Data":"c4ec284a1673b6837e0ef1ecaf7b6eda7f6d6589b0de6c7dace3b017dbaef5d6"} Jul 14 14:37:38.275551 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:38.275032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccn9n/must-gather-nq2hd" event={"ID":"4ce3f724-9312-40b6-994a-d673eb87f6b6","Type":"ContainerStarted","Data":"93fca1cfb10d6ca046e355bc851e77146bde5ba82373ea7b5b55edb9800bf1c5"} Jul 14 14:37:38.303394 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:38.303344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ccn9n/must-gather-nq2hd" podStartSLOduration=1.6026431319999999 podStartE2EDuration="2.303326295s" totalImagesPullingTime="700.683163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:37:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:37:38.301506921 +0000 UTC m=+480.609152375" watchObservedRunningTime="2026-07-14 14:37:38.303326295 +0000 UTC m=+480.610971745" Jul 14 14:37:39.101205 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:39.101168 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qtgq5_f81facd7-e23c-4c7c-aaeb-e38d0accf0c3/global-pull-secret-syncer/0.log" Jul 14 14:37:39.213824 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:39.213795 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" Jul 14 14:37:39.317157 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:39.317127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-71.ec2.internal_7315c1a2bc3628ff72348aa227de3e72/haproxy/0.log" Jul 14 14:37:41.401665 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.401624 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-gdpqw/must-gather-s6fhm"] Jul 14 14:37:41.402151 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.401898 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="copy" containerID="cri-o://683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640" gracePeriod=2 Jul 14 14:37:41.405761 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:37:41.405266 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s6fhm\" is forbidden: User \"system:node:ip-10-0-134-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gdpqw\": no relationship found between node 'ip-10-0-134-71.ec2.internal' and this object" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:41.405761 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.405497 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-gdpqw/must-gather-s6fhm"] Jul 14 14:37:41.767202 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.767106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gdpqw_must-gather-s6fhm_446b2d5d-858d-4b67-a55b-1a3388f5fd77/copy/0.log" Jul 14 14:37:41.771493 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.770330 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:41.773468 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:37:41.772711 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s6fhm\" is forbidden: User \"system:node:ip-10-0-134-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gdpqw\": no relationship found between node 'ip-10-0-134-71.ec2.internal' and this object" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:41.935848 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.935808 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2njm\" (UniqueName: \"kubernetes.io/projected/446b2d5d-858d-4b67-a55b-1a3388f5fd77-kube-api-access-m2njm\") pod \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " Jul 14 14:37:41.936223 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.936203 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/446b2d5d-858d-4b67-a55b-1a3388f5fd77-must-gather-output\") pod \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\" (UID: \"446b2d5d-858d-4b67-a55b-1a3388f5fd77\") " Jul 14 14:37:41.936575 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.936541 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/446b2d5d-858d-4b67-a55b-1a3388f5fd77-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "446b2d5d-858d-4b67-a55b-1a3388f5fd77" (UID: "446b2d5d-858d-4b67-a55b-1a3388f5fd77"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:41.940476 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.937111 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/446b2d5d-858d-4b67-a55b-1a3388f5fd77-must-gather-output\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:37:41.940476 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:41.939416 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/446b2d5d-858d-4b67-a55b-1a3388f5fd77-kube-api-access-m2njm" (OuterVolumeSpecName: "kube-api-access-m2njm") pod "446b2d5d-858d-4b67-a55b-1a3388f5fd77" (UID: "446b2d5d-858d-4b67-a55b-1a3388f5fd77"). InnerVolumeSpecName "kube-api-access-m2njm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:37:42.011090 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.011010 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:42.037933 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.037897 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2njm\" (UniqueName: \"kubernetes.io/projected/446b2d5d-858d-4b67-a55b-1a3388f5fd77-kube-api-access-m2njm\") on node \"ip-10-0-134-71.ec2.internal\" DevicePath \"\"" Jul 14 14:37:42.073628 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.073586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248pl_1ab2b228-5d1d-42e5-85b0-f27fb40de843/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:42.204951 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.204918 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" path="/var/lib/kubelet/pods/446b2d5d-858d-4b67-a55b-1a3388f5fd77/volumes" Jul 14 14:37:42.298553 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.298384 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gdpqw_must-gather-s6fhm_446b2d5d-858d-4b67-a55b-1a3388f5fd77/copy/0.log" Jul 14 14:37:42.300289 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.299243 2577 generic.go:356] "Generic (PLEG): container finished" podID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerID="683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640" exitCode=143 Jul 14 14:37:42.300289 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.299364 2577 scope.go:117] "RemoveContainer" containerID="683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640" Jul 14 14:37:42.300289 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.299535 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdpqw/must-gather-s6fhm" Jul 14 14:37:42.313264 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.313242 2577 scope.go:117] "RemoveContainer" containerID="cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f" Jul 14 14:37:42.336228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.336089 2577 scope.go:117] "RemoveContainer" containerID="683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640" Jul 14 14:37:42.336857 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:37:42.336704 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640\": container with ID starting with 683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640 not found: ID does not exist" containerID="683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640" Jul 14 14:37:42.336857 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.336746 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640"} err="failed to get container status \"683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640\": rpc error: code = NotFound desc = could not find container \"683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640\": container with ID starting with 683041ef32d2a692f2446f46ef471bf1043a8efabc99bf0029f8b8ee7048a640 not found: ID does not exist" Jul 14 14:37:42.336857 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.336773 2577 scope.go:117] "RemoveContainer" containerID="cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f" Jul 14 14:37:42.337370 ip-10-0-134-71 kubenswrapper[2577]: E0714 14:37:42.337310 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f\": container with ID starting with cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f not found: ID does not exist" containerID="cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f" Jul 14 14:37:42.337370 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:42.337339 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f"} err="failed to get container status \"cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f\": rpc error: code = NotFound desc = could not find container \"cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f\": container with ID starting with cb519aeff2aba4ec00d11f070f6592cfa2b16a4411150ac9969556dd9c69df7f not found: ID does not exist" Jul 14 14:37:43.495827 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.495791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-8hmn7_38f215a5-d203-4cbb-9d9f-9c64b40ba381/cluster-monitoring-operator/0.log" Jul 14 14:37:43.531038 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.531001 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gfllm_02e2b10d-9c15-4276-9f46-0d08afb48411/kube-state-metrics/0.log" Jul 14 14:37:43.553662 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.553626 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gfllm_02e2b10d-9c15-4276-9f46-0d08afb48411/kube-rbac-proxy-main/0.log" Jul 14 14:37:43.576738 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.576660 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gfllm_02e2b10d-9c15-4276-9f46-0d08afb48411/kube-rbac-proxy-self/0.log" Jul 14 14:37:43.640699 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.640665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-8252d_39a5d93b-302e-472b-96e2-d992472ff7a8/monitoring-plugin/0.log" Jul 14 14:37:43.686047 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.685967 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47fjv_6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7/node-exporter/0.log" Jul 14 14:37:43.717169 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.717138 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47fjv_6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7/kube-rbac-proxy/0.log" Jul 14 14:37:43.739757 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:43.739726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47fjv_6b6fac26-46c8-4c31-9d0d-cfdec4dba7a7/init-textfile/0.log" Jul 14 14:37:44.039683 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.039610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/prometheus/0.log" Jul 14 14:37:44.064360 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.064322 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/config-reloader/0.log" Jul 14 14:37:44.094219 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.094188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/thanos-sidecar/0.log" Jul 14 14:37:44.125695 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.125611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/kube-rbac-proxy-web/0.log" Jul 14 14:37:44.149282 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.149241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/kube-rbac-proxy/0.log" Jul 14 14:37:44.173203 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.173173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/kube-rbac-proxy-thanos/0.log" Jul 14 14:37:44.198018 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.197989 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8221703e-5915-4f4a-bc54-9c4572d368a8/init-config-reloader/0.log" Jul 14 14:37:44.227825 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.227788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xb7wl_bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b/prometheus-operator/0.log" Jul 14 14:37:44.250990 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.250960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xb7wl_bdb4ab15-d10a-4d02-a6e6-e2a2d6d5383b/kube-rbac-proxy/0.log" Jul 14 14:37:44.279733 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:44.279692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-x5xzn_7ee29b61-8ae8-4d72-bf9f-96082d96bfca/prometheus-operator-admission-webhook/0.log" Jul 14 14:37:46.802945 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:46.802913 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86485b4bc6-9h68g_fa551b22-7eca-4ce4-880d-c3b5038031ee/console/0.log" Jul 14 14:37:47.358875 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.358843 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-tgbv4_af720145-9696-4937-b39d-1be4220e68a9/volume-data-source-validator/0.log" Jul 14 14:37:47.386912 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.386877 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz"] Jul 14 14:37:47.387937 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.387909 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="gather" Jul 14 14:37:47.388097 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.388085 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="gather" Jul 14 14:37:47.388204 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.388193 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="copy" Jul 14 14:37:47.388283 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.388274 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="copy" Jul 14 14:37:47.388587 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.388569 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="gather" Jul 14 14:37:47.388727 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.388714 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="446b2d5d-858d-4b67-a55b-1a3388f5fd77" containerName="copy" Jul 14 14:37:47.395072 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.395048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.400930 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.400904 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz"] Jul 14 14:37:47.494383 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.494341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-podres\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.494612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.494390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt7br\" (UniqueName: \"kubernetes.io/projected/c57644e2-1dcb-4a39-917f-ef3899c71e08-kube-api-access-jt7br\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.494612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.494490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-lib-modules\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.494612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.494517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-proc\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.494612 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.494566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-sys\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.594964 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.594929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-lib-modules\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.594964 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.594971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-proc\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-sys\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-podres\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt7br\" (UniqueName: \"kubernetes.io/projected/c57644e2-1dcb-4a39-917f-ef3899c71e08-kube-api-access-jt7br\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-lib-modules\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-proc\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595228 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-sys\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.595531 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.595295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c57644e2-1dcb-4a39-917f-ef3899c71e08-podres\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.604521 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.604490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt7br\" (UniqueName: \"kubernetes.io/projected/c57644e2-1dcb-4a39-917f-ef3899c71e08-kube-api-access-jt7br\") pod \"perf-node-gather-daemonset-zdnwz\" (UID: \"c57644e2-1dcb-4a39-917f-ef3899c71e08\") " pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.708178 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.708143 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:47.875036 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:47.874949 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz"] Jul 14 14:37:48.337367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:48.337275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" event={"ID":"c57644e2-1dcb-4a39-917f-ef3899c71e08","Type":"ContainerStarted","Data":"d723c6b293d9a9a0c6380651d0ea10c57502fc10356fc72637f5a196b478d680"} Jul 14 14:37:48.337367 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:48.337343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" event={"ID":"c57644e2-1dcb-4a39-917f-ef3899c71e08","Type":"ContainerStarted","Data":"81a89cefc64e911666fbf88961c70669428139de1bac3eeb15f7b8f1af8cbe8c"} Jul 14 14:37:48.337642 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:48.337388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:48.469008 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:48.468952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwmh9_d8ce8931-520a-422e-ab09-8599f1ca6f1b/dns/0.log" Jul 14 14:37:48.493120 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:48.493094 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwmh9_d8ce8931-520a-422e-ab09-8599f1ca6f1b/kube-rbac-proxy/0.log" Jul 14 14:37:48.514573 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:48.514544 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tpnl_9ae7f047-c5a7-46f2-b739-7380f69e766c/dns-node-resolver/0.log" Jul 14 14:37:49.065620 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:49.065590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lkmv6_10382172-3705-48c8-bcf0-200aff807c59/node-ca/0.log" Jul 14 14:37:50.182272 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:50.182235 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfzpd_087142ff-5423-41d4-b1f6-1df250d0e444/serve-healthcheck-canary/0.log" Jul 14 14:37:50.673156 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:50.673082 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrl8m_386db8ca-8205-49d6-8998-099cc656148c/kube-rbac-proxy/0.log" Jul 14 14:37:50.692710 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:50.692684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrl8m_386db8ca-8205-49d6-8998-099cc656148c/exporter/0.log" Jul 14 14:37:50.712861 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:50.712834 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrl8m_386db8ca-8205-49d6-8998-099cc656148c/extractor/0.log" Jul 14 14:37:54.352586 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:54.352557 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" Jul 14 14:37:54.369412 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:54.369278 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ccn9n/perf-node-gather-daemonset-zdnwz" podStartSLOduration=7.369259415 podStartE2EDuration="7.369259415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:37:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:37:48.357426276 +0000 UTC m=+490.665071727" watchObservedRunningTime="2026-07-14 14:37:54.369259415 +0000 UTC m=+496.676904867" Jul 14 14:37:57.190963 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:57.190924 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bn2gz_6406a951-eecf-4c6e-98fd-98e5b434f4cf/kube-storage-version-migrator-operator/1.log" Jul 14 14:37:57.192721 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:57.192686 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bn2gz_6406a951-eecf-4c6e-98fd-98e5b434f4cf/kube-storage-version-migrator-operator/0.log" Jul 14 14:37:58.388315 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.388284 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/kube-multus-additional-cni-plugins/0.log" Jul 14 14:37:58.410668 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.410634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/egress-router-binary-copy/0.log" Jul 14 14:37:58.434572 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.434544 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/cni-plugins/0.log" Jul 14 14:37:58.457832 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.457806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/bond-cni-plugin/0.log" Jul 14 14:37:58.483928 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.483900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/routeoverride-cni/0.log" Jul 14 14:37:58.507091 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.507067 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/whereabouts-cni-bincopy/0.log" Jul 14 14:37:58.527227 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.527203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vwnw8_fc09f6df-0421-414e-b5a6-8e813ee902d0/whereabouts-cni/0.log" Jul 14 14:37:58.591282 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.591251 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b8x8z_f5b694f2-18ef-4c8c-b7a8-97a24dfca8f9/kube-multus/0.log" Jul 14 14:37:58.645749 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.645665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-42nkf_799ad4f3-3e43-40aa-87d9-cb11ce14c188/network-metrics-daemon/0.log" Jul 14 14:37:58.680249 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:58.680208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-42nkf_799ad4f3-3e43-40aa-87d9-cb11ce14c188/kube-rbac-proxy/0.log" Jul 14 14:37:59.922865 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:59.922822 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-controller/0.log" Jul 14 14:37:59.953993 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:59.953947 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/1.log" Jul 14 14:37:59.954168 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:59.953968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovn-acl-logging/0.log" Jul 14 14:37:59.992747 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:37:59.992718 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/kube-rbac-proxy-node/0.log" Jul 14 14:38:00.031878 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:00.031851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/kube-rbac-proxy-ovn-metrics/0.log" Jul 14 14:38:00.070357 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:00.070331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/northd/0.log" Jul 14 14:38:00.111561 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:00.111534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/nbdb/0.log" Jul 14 14:38:00.149988 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:00.149954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/sbdb/0.log" Jul 14 14:38:00.227051 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:00.227022 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qq9kk_85a806b8-859e-4313-b082-b9e332805c36/ovnkube-controller/0.log" Jul 14 14:38:01.565039 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:01.565006 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-cbjk6_6da94a90-c87c-4364-8062-bcf6ab75029d/check-endpoints/0.log" Jul 14 14:38:01.621819 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:01.621786 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vq5qb_4c031eb7-4207-48ce-bf46-ae7303b30d8a/network-check-target-container/0.log" Jul 14 14:38:02.576227 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:02.576199 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xfjmb_b307d70e-2f70-4fed-82be-60927c1595d8/iptables-alerter/0.log" Jul 14 14:38:03.253270 ip-10-0-134-71 kubenswrapper[2577]: I0714 14:38:03.253236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9f2jv_639b1d12-b575-4032-b484-15237f204edc/tuned/0.log"