Jul 07 16:32:50.809095 ip-10-0-136-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 16:32:50.809108 ip-10-0-136-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 16:32:50.809116 ip-10-0-136-167 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 16:32:50.809444 ip-10-0-136-167 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 16:33:00.831942 ip-10-0-136-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 16:33:00.831955 ip-10-0-136-167 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 878b9c610b7043c2a09f02b3fd519b2c -- Jul 07 16:35:02.579806 ip-10-0-136-167 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.971497 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977000 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977011 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977015 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977019 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977024 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977028 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:35:03.028135 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977031 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977035 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977038 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977040 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977044 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977046 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977049 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977052 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977055 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977057 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977061 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977064 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977067 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977069 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977072 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977075 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977078 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977081 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977085 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977087 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:35:03.029244 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977090 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977093 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977096 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977098 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977101 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977104 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977106 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977109 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977111 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977114 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977116 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977119 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977121 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977126 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977129 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977132 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977136 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977139 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977142 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977144 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:35:03.030136 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977147 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977149 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977152 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977155 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977158 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977160 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977163 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977165 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977168 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977170 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977173 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977175 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977178 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977181 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977183 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977187 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977189 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977192 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977194 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977197 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:35:03.031014 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977199 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977202 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977204 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977206 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977209 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977212 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977215 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977217 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977220 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977223 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977225 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977228 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977230 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977232 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977235 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977238 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977240 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977242 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977245 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977248 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:35:03.031888 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977250 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977253 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977255 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977258 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977260 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977263 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977265 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977268 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977270 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977273 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977276 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977280 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977283 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977992 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.977999 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978002 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978005 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978008 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978010 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978013 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:35:03.032780 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978016 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978019 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978025 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978028 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978031 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978034 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978037 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978039 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978042 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978044 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978047 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978049 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978052 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978054 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978057 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978060 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978062 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978064 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978067 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978069 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:35:03.033659 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978072 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978075 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978078 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978080 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978083 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978086 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978088 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978091 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978093 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978096 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978099 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978102 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978105 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978107 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978110 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978114 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978116 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978119 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978123 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978126 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:35:03.034551 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978128 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978131 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978133 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978136 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978139 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978141 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978144 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978147 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978151 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978154 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978157 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978160 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978163 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978166 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978168 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978171 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978173 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978176 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978178 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:35:03.035442 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978181 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978183 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978185 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978188 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978191 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978193 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978197 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978200 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978204 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978207 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978210 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978213 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978216 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978218 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978221 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978224 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978226 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978229 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978231 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:35:03.036314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978234 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978236 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978238 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978241 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978243 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978246 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978248 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978252 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978255 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978257 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978260 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978262 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978265 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978267 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978637 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978643 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978650 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978653 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:35:03.037214 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978657 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978659 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978662 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978665 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978668 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978671 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978674 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978677 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978679 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978682 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978685 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978688 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978690 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978693 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978695 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978698 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978700 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978703 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978705 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978708 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:35:03.038100 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978710 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978713 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978716 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978718 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978721 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978723 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978726 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978728 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978731 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978733 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978738 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978742 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978745 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978748 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978751 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978754 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978757 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978760 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978764 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:35:03.038975 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978766 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978769 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978771 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978774 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978777 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978779 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978782 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978785 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978787 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978789 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978792 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978795 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978797 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978799 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978802 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978804 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978807 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978810 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978812 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978815 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:35:03.039859 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978817 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978820 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978822 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978826 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978828 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978831 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978833 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978836 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978838 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978841 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978843 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978847 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978850 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978852 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978855 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978857 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978860 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978863 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978865 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978868 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:35:03.040744 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978870 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978875 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978878 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978880 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978883 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978885 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978888 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978890 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978893 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978895 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978898 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978900 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978903 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978905 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978908 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.978911 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978972 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978979 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978984 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978989 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978992 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:35:03.041847 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978995 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.978999 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979004 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979009 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979012 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979015 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979019 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979022 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979025 2555 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979028 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979031 2555 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979033 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979036 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979040 2555 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979043 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979046 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979049 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979052 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979056 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979059 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979062 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979065 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979068 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979071 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:35:03.042731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979074 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979077 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979081 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979085 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979088 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979090 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979093 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979096 2555 flags.go:64] FLAG: --enable-server="true" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979099 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979103 2555 flags.go:64] FLAG: --event-burst="100" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979109 2555 flags.go:64] FLAG: --event-qps="50" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979112 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979116 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979119 2555 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979122 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979125 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979128 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979131 2555 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979134 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979137 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979140 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979142 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979145 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979148 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979150 2555 flags.go:64] FLAG: --feature-gates="" Jul 07 16:35:03.043825 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979154 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979157 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979160 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979163 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979166 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979169 2555 flags.go:64] FLAG: --help="false" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979172 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979175 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979178 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979182 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979185 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979189 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979192 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979195 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979197 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979200 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979203 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979207 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979210 2555 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979213 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979216 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979219 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979222 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979225 2555 flags.go:64] FLAG: --lock-file="" Jul 07 16:35:03.044931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979227 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979230 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979233 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979238 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979241 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979243 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979246 2555 flags.go:64] FLAG: --logging-format="text" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979249 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979252 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979255 2555 flags.go:64] FLAG: --manifest-url="" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979258 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979261 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979264 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979268 2555 flags.go:64] FLAG: --max-pods="110" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979271 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979274 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979277 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979281 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979284 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979287 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979290 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979297 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979300 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979303 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:35:03.048370 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979306 2555 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979310 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979315 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979318 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979321 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979324 2555 flags.go:64] FLAG: --port="10250" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979327 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979330 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d03d2de9be82c5e8" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979333 2555 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979336 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979339 2555 flags.go:64] FLAG: --register-node="true" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979342 2555 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979345 2555 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979348 2555 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979351 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979353 2555 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979357 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979360 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979363 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979366 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979368 2555 flags.go:64] FLAG: --runonce="false" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979371 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979374 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979377 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979380 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:35:03.049488 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979382 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979387 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979390 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979393 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979396 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979399 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979401 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979404 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979408 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979411 2555 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979414 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979419 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979421 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979424 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979428 2555 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979431 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979433 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979437 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979439 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979442 2555 flags.go:64] FLAG: --v="2" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979446 2555 flags.go:64] FLAG: --version="false" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979450 2555 flags.go:64] FLAG: --vmodule="" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979453 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.979456 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979586 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:35:03.128116 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979590 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:35:03.067121 ip-10-0-136-167 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979593 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979596 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979599 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979601 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979604 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979606 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979610 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979614 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979617 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979619 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979622 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979624 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979627 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979629 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979634 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979637 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979639 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979642 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979645 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:35:03.129314 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979647 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979651 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979653 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979656 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979658 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979661 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979663 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979666 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979669 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979672 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979676 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979679 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979682 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979684 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979687 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979689 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979692 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979694 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979697 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979699 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:35:03.130323 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979703 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979705 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979708 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979711 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979713 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979716 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979718 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979722 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979725 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979728 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979730 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979732 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979735 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979737 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979740 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979743 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979745 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979748 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979750 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979753 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:35:03.131149 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979756 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979758 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979760 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979763 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979765 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979768 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979770 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979773 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979777 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979780 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979783 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979786 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979790 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979793 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979795 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979798 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979801 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979803 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979806 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:35:03.131760 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979810 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979812 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979815 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979817 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979820 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979823 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979825 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979828 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979831 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979833 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979835 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979838 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979840 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979843 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979857 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979861 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979864 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979868 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:35:03.132367 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.979871 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.980449 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.986676 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.986689 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.986707 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.986712 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986767 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986773 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986776 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986779 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986782 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986784 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986787 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986790 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986792 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:35:03.132981 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986795 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986797 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986800 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986803 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986805 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986808 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986810 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986813 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986815 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986818 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986820 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986823 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986826 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986828 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986831 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986834 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986837 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986839 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986842 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986845 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:35:03.133807 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986848 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986851 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986853 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986856 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986858 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986861 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986863 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986866 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986868 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986871 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986873 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986876 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986879 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986881 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986884 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986886 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986889 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986891 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986894 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986896 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:35:03.134380 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986899 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986901 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986903 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986906 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986908 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986911 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986913 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986916 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986918 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986920 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986923 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986927 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986931 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986935 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986938 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986940 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986943 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986945 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986948 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986951 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:35:03.135035 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986953 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986955 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986958 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986961 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986964 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986968 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986972 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986975 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986978 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986980 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986983 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986985 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986988 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986990 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986993 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986996 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.986998 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987000 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987003 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:35:03.135631 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987005 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987008 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987010 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987013 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987016 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987020 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987023 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987026 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987029 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987032 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987034 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.987039 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987143 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987149 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:35:03.136201 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987152 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987154 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987161 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987163 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987166 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987169 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987172 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987174 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987178 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987181 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987184 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987187 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987190 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987193 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987195 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987198 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987200 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987203 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987205 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:35:03.136660 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987208 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987211 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987213 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987217 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987220 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987224 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987226 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987229 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987232 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987234 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987237 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987244 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987246 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987249 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987252 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987256 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987258 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987261 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987263 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987266 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:35:03.137203 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987268 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987271 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987273 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987276 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987279 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987281 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987284 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987286 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987289 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987291 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987294 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987297 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987299 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987302 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987304 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987307 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987309 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987311 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987314 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:35:03.137792 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987316 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987320 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987322 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987325 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987328 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987331 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987333 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987336 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987340 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987342 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987345 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987347 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987350 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987352 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987355 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987357 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987360 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987362 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987365 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987368 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:35:03.138327 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987370 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987373 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987375 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987378 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987380 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987383 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987385 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987388 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987390 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987393 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987395 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987397 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987400 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987403 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987405 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987408 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987411 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987414 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:35:03.138908 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:02.987417 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.987421 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.987508 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.989541 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.990924 2555 server.go:1019] "Starting client certificate rotation" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.991016 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.991049 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.993647 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:02.998398 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.008412 2555 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.010473 2555 log.go:25] "Validated CRI v1 image API" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.013799 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:35:03.139453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.020414 2555 fs.go:135] Filesystem UUIDs: map[1d358080-ac32-4d23-8a1d-69409b9f3dbb:/dev/nvme0n1p4 4eb5993d-db86-4dd7-b8d2-73f0b381b241:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 16:35:03.139919 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.020427 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.024611 2555 manager.go:216] Machine: {Timestamp:2026-07-07 16:35:03.023533475 +0000 UTC m=+0.329018110 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101102 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a457c8d0f20c36d630cda6d9ad99a SystemUUID:ec2a457c-8d0f-20c3-6d63-0cda6d9ad99a BootID:878b9c61-0b70-43c2-a09f-02b3fd519b2c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:2b:9c:65:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:2b:9c:65:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:72:fe:aa:4c:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.024702 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.024799 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.027805 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.027833 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.028489 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.028500 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:35:03.140030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.028506 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.029114 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.030374 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.033366 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.033474 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034118 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034132 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034154 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034166 2555 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034177 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034548 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.034568 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.059577 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.061507 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.061548 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062704 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062717 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062725 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062730 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062740 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062748 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062758 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062763 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062770 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062775 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062783 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.062788 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.063389 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.063398 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.066363 2555 server.go:1268] "Started kubelet" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.066446 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.066491 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.066585 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.067695 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.068676 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.071506 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.071608 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.071734 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.073361 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.073696 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:35:03.140722 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.082492 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.083209 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.083228 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.083408 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.083476 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.083486 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.084153 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.083213 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-167.ec2.internal.18c00f24c6bea1a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-167.ec2.internal,UID:ip-10-0-136-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-167.ec2.internal,},FirstTimestamp:2026-07-07 16:35:03.066337701 +0000 UTC m=+0.371822314,LastTimestamp:2026-07-07 16:35:03.066337701 +0000 UTC m=+0.371822314,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-167.ec2.internal,}" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.084415 2555 factory.go:55] Registering systemd factory Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.084429 2555 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.085025 2555 factory.go:153] Registering CRI-O factory Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.085043 2555 factory.go:223] Registration of the crio container factory successfully Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.085098 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.085125 2555 factory.go:103] Registering Raw factory Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.085140 2555 manager.go:1196] Started watching for new ooms in manager Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.085569 2555 manager.go:349] Starting recovery of all containers Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.096076 2555 manager.go:354] Recovery completed Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.099939 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.101897 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.101923 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.101932 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.102418 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.102426 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.102427 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.102441 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.103097 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.103116 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.103125 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.103854 2555 policy_none.go:49] "None policy: Start" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.103866 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.103875 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.104936 2555 policy_none.go:47] "Start" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.105960 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:35:03.141861 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.111518 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.111654 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.111700 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-167.ec2.internal.18c00f24c8dd6b56 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-167.ec2.internal,UID:ip-10-0-136-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-167.ec2.internal,},FirstTimestamp:2026-07-07 16:35:03.101909846 +0000 UTC m=+0.407394459,LastTimestamp:2026-07-07 16:35:03.101909846 +0000 UTC m=+0.407394459,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-167.ec2.internal,}" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.115474 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-167.ec2.internal.18c00f24c8ddaeb8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-167.ec2.internal,UID:ip-10-0-136-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-167.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-167.ec2.internal,},FirstTimestamp:2026-07-07 16:35:03.101927096 +0000 UTC m=+0.407411708,LastTimestamp:2026-07-07 16:35:03.101927096 +0000 UTC m=+0.407411708,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-167.ec2.internal,}" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.118644 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kv676" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.120717 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kv676" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.121031 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-167.ec2.internal.18c00f24c8ddd32e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-167.ec2.internal,UID:ip-10-0-136-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-167.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-167.ec2.internal,},FirstTimestamp:2026-07-07 16:35:03.10193643 +0000 UTC m=+0.407421043,LastTimestamp:2026-07-07 16:35:03.10193643 +0000 UTC m=+0.407421043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-167.ec2.internal,}" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.125006 2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-167.ec2.internal.18c00f24c8dd6b56\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-167.ec2.internal.18c00f24c8dd6b56 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-167.ec2.internal,UID:ip-10-0-136-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-167.ec2.internal,},FirstTimestamp:2026-07-07 16:35:03.101909846 +0000 UTC m=+0.407394459,LastTimestamp:2026-07-07 16:35:03.103105915 +0000 UTC m=+0.408590528,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-167.ec2.internal,}" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143193 2555 manager.go:337] "Starting Device Plugin manager" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.143218 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:35:03.143397 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143227 2555 server.go:87] "Starting device plugin registration server" Jul 07 16:35:03.144284 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143451 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:35:03.144284 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143464 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:35:03.144284 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143673 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:35:03.144284 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143765 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:35:03.144284 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.143774 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:35:03.144885 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.144322 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:35:03.144885 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.144366 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.243691 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.244564 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.244588 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.244598 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.244619 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.253175 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.253191 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-167.ec2.internal\": node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.280356 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.281467 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.281504 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.281583 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.281623 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.283106 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.287052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.283629 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.385624 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.385630 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal"] Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.385691 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.387071 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.387101 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.387115 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.388369 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.388478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.388504 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.389040 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.389062 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.389075 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.389044 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.389105 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.389116 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.390566 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.390592 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.391210 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.391227 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.391241 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.422301 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-167.ec2.internal\" not found" node="ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.479220 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.426783 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-167.ec2.internal\" not found" node="ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.486614 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.486663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.486688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/684e505a654ab219cfa598f20931a3ab-config\") pod \"kube-apiserver-proxy-ip-10-0-136-167.ec2.internal\" (UID: \"684e505a654ab219cfa598f20931a3ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.486704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.587748 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.587769 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.587793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.587810 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/684e505a654ab219cfa598f20931a3ab-config\") pod \"kube-apiserver-proxy-ip-10-0-136-167.ec2.internal\" (UID: \"684e505a654ab219cfa598f20931a3ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.587844 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.587843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.651020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.587887 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/684e505a654ab219cfa598f20931a3ab-config\") pod \"kube-apiserver-proxy-ip-10-0-136-167.ec2.internal\" (UID: \"684e505a654ab219cfa598f20931a3ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.818857 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.689713 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.818857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.727488 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.818857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.731822 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 16:35:03.818857 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.790340 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.999448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.883566 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:35:03.999448 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.890989 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.999448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.991458 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:35:03.999448 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:03.991457 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:03.999448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.991585 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:35:03.999448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:03.991611 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:35:04.161688 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:04.092498 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 16:35:04.161688 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.125409 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:30:04 +0000 UTC" deadline="2028-01-04 12:55:22.132685919 +0000 UTC" Jul 07 16:35:04.161688 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.125446 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13100h20m18.007246966s" Jul 07 16:35:04.355544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.175588 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:35:04.355544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.183413 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 16:35:04.355544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.202398 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:35:04.355544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.203327 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 16:35:04.355544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.214048 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:35:04.355544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.237086 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:35:04.723515 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:04.557345 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684e505a654ab219cfa598f20931a3ab.slice/crio-a12d8cebbd067cfb51c5b420b2416a4d9b1c96a781830c53d719c95364c17ea4 WatchSource:0}: Error finding container a12d8cebbd067cfb51c5b420b2416a4d9b1c96a781830c53d719c95364c17ea4: Status 404 returned error can't find the container with id a12d8cebbd067cfb51c5b420b2416a4d9b1c96a781830c53d719c95364c17ea4 Jul 07 16:35:04.723515 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:04.558117 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbd14da7139adf25758f98178d8d0ef.slice/crio-b02eccef2dd4a46e27f63f5152e3358be692f08f62b580391d970656abca75fd WatchSource:0}: Error finding container b02eccef2dd4a46e27f63f5152e3358be692f08f62b580391d970656abca75fd: Status 404 returned error can't find the container with id b02eccef2dd4a46e27f63f5152e3358be692f08f62b580391d970656abca75fd Jul 07 16:35:04.723515 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:04.564523 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.037567 2555 apiserver.go:52] "Watching apiserver" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.046783 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.047905 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-rccks","openshift-multus/multus-q895n","openshift-multus/network-metrics-daemon-s785t","openshift-ovn-kubernetes/ovnkube-node-n7vwl","kube-system/global-pull-secret-syncer-7jqvn","kube-system/konnectivity-agent-8mmjw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw","openshift-image-registry/node-ca-cf2hz","openshift-network-diagnostics/network-check-target-6gt9j","openshift-network-operator/iptables-alerter-pjnsv","kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ntvlj","openshift-dns/node-resolver-vz7rh"] Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.055138 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.056340 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.058110 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q895n" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.059031 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.059093 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.059165 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.059328 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dj555\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.059936 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.060090 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ncr6\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.060028 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.060375 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.060904 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.060974 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nt556\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.061276 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.061304 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.061515 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.063045 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.065039 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.065096 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.066590 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.066956 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.066960 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.067049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.067012 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:35:05.068046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.067033 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:35:05.068046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.067170 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:35:05.068046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.067198 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.068046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.067356 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbpm4\"" Jul 07 16:35:05.068243 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.068103 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.069705 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.069689 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:35:05.069790 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.069699 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.069860 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.069843 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.070258 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.070244 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tgjxl\"" Jul 07 16:35:05.071294 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.071278 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:05.071363 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.071344 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:05.072592 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.072578 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.074017 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.073999 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.075716 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.075701 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:35:05.080932 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.080914 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:35:05.081288 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.081274 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.082247 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.082231 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:35:05.082339 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.082325 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sqkp9\"" Jul 07 16:35:05.082375 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.082333 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.084231 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.084216 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:35:05.084540 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.084524 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zjfw4\"" Jul 07 16:35:05.084844 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.084823 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.085432 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.085405 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.085915 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.085900 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gggqx\"" Jul 07 16:35:05.085994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.085920 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:35:05.086119 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.086104 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:35:05.086189 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.086128 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ncqjc\"" Jul 07 16:35:05.086189 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.086145 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.086701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.086684 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:35:05.086894 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.086881 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:35:05.095314 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.095295 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:35:05.102706 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102689 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22494f3d-9978-4b22-8ea6-4582900753e4-host\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.102791 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-sys-fs\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.102791 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6269\" (UniqueName: \"kubernetes.io/projected/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-kube-api-access-n6269\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.102791 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102754 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-kubernetes\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.102791 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-cni-netd\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.102973 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102813 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krw5k\" (UniqueName: \"kubernetes.io/projected/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-kube-api-access-krw5k\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.102973 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.102973 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102899 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-systemd\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.102973 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-run\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.102973 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102966 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-hostroot\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.102991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-kubelet\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-systemd-units\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103040 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovn-node-metrics-cert\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-device-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b1e6f79-37c1-4239-89e0-744d9e2a5862-tmp-dir\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cni-binary-copy\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103131 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103145 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-modprobe-d\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.103160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovnkube-script-lib\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f50472-ba9e-48d4-b268-c936e6062594-host-slash\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-cnibin\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-conf-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103264 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-etc-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-log-socket\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21f50472-ba9e-48d4-b268-c936e6062594-iptables-alerter-script\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjvpq\" (UniqueName: \"kubernetes.io/projected/21f50472-ba9e-48d4-b268-c936e6062594-kube-api-access-hjvpq\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysconfig\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103425 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40529acc-e965-45c3-8af8-7f9d7d80d319-tmp\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.103452 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-cni-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-tuned\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-netns\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-kubelet\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-etc-kubernetes\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103582 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-ovn\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103678 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-env-overrides\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-daemon-config\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-system-cni-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-systemd\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.103922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8bnd\" (UniqueName: \"kubernetes.io/projected/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-kube-api-access-x8bnd\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40354d1e-f46b-4d14-a595-cf1e198a7d0d-agent-certs\") pod \"konnectivity-agent-8mmjw\" (UID: \"40354d1e-f46b-4d14-a595-cf1e198a7d0d\") " pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whfbh\" (UniqueName: \"kubernetes.io/projected/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-kube-api-access-whfbh\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.103998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104031 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d57cce7-ddc8-47f9-9abb-307d0125974d-kubelet-config\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-socket-dir-parent\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104092 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-var-lib-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-node-log\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-lib-modules\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac160e25-d0ef-4276-9d27-654476ec96a2-cni-binary-copy\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-cni-multus\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104262 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-registration-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.104645 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-os-release\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-socket-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovnkube-config\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22494f3d-9978-4b22-8ea6-4582900753e4-serviceca\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104464 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xkv2\" (UniqueName: \"kubernetes.io/projected/22494f3d-9978-4b22-8ea6-4582900753e4-kube-api-access-4xkv2\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5cq\" (UniqueName: \"kubernetes.io/projected/2b1e6f79-37c1-4239-89e0-744d9e2a5862-kube-api-access-fm5cq\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysctl-d\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104565 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcxf\" (UniqueName: \"kubernetes.io/projected/40529acc-e965-45c3-8af8-7f9d7d80d319-kube-api-access-gtcxf\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-k8s-cni-cncf-io\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104670 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-cni-bin\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysctl-conf\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104715 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-sys\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-os-release\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104811 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wdmn\" (UniqueName: \"kubernetes.io/projected/ac160e25-d0ef-4276-9d27-654476ec96a2-kube-api-access-2wdmn\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.105161 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104880 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d57cce7-ddc8-47f9-9abb-307d0125974d-dbus\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cnibin\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104937 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-var-lib-kubelet\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-host\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.104985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-multus-certs\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105004 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-run-netns\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b1e6f79-37c1-4239-89e0-744d9e2a5862-hosts-file\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105054 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-system-cni-dir\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40354d1e-f46b-4d14-a595-cf1e198a7d0d-konnectivity-ca\") pod \"konnectivity-agent-8mmjw\" (UID: \"40354d1e-f46b-4d14-a595-cf1e198a7d0d\") " pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-cni-bin\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.105769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.105162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-slash\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.124373 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.124351 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gs5n" Jul 07 16:35:05.134651 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.134634 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gs5n" Jul 07 16:35:05.206158 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-system-cni-dir\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40354d1e-f46b-4d14-a595-cf1e198a7d0d-konnectivity-ca\") pod \"konnectivity-agent-8mmjw\" (UID: \"40354d1e-f46b-4d14-a595-cf1e198a7d0d\") " pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206200 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-cni-bin\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206216 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-slash\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206231 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22494f3d-9978-4b22-8ea6-4582900753e4-host\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206251 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-system-cni-dir\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206252 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-sys-fs\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206273 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-cni-bin\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206298 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-slash\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206303 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22494f3d-9978-4b22-8ea6-4582900753e4-host\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206304 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6269\" (UniqueName: \"kubernetes.io/projected/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-kube-api-access-n6269\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-sys-fs\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-kubernetes\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.206709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-cni-netd\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206426 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krw5k\" (UniqueName: \"kubernetes.io/projected/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-kube-api-access-krw5k\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206453 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206478 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-systemd\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-run\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206528 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-hostroot\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206475 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-kubernetes\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.206565 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-kubelet\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206596 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-systemd-units\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-systemd\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.206651 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:35:05.706607067 +0000 UTC m=+3.012091691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206652 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-systemd-units\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206676 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovn-node-metrics-cert\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.207399 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-kubelet\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206704 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-hostroot\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-run\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206706 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-device-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206478 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-cni-netd\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b1e6f79-37c1-4239-89e0-744d9e2a5862-tmp-dir\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-device-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206808 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40354d1e-f46b-4d14-a595-cf1e198a7d0d-konnectivity-ca\") pod \"konnectivity-agent-8mmjw\" (UID: \"40354d1e-f46b-4d14-a595-cf1e198a7d0d\") " pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cni-binary-copy\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206869 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206879 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-modprobe-d\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206922 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovnkube-script-lib\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.208116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.206977 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f50472-ba9e-48d4-b268-c936e6062594-host-slash\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207003 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-cnibin\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207023 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-conf-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207097 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b1e6f79-37c1-4239-89e0-744d9e2a5862-tmp-dir\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207120 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f50472-ba9e-48d4-b268-c936e6062594-host-slash\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207027 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-conf-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207159 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-etc-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-cnibin\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207158 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-log-socket\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207218 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-log-socket\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21f50472-ba9e-48d4-b268-c936e6062594-iptables-alerter-script\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjvpq\" (UniqueName: \"kubernetes.io/projected/21f50472-ba9e-48d4-b268-c936e6062594-kube-api-access-hjvpq\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207259 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-modprobe-d\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.208857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207275 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysconfig\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cni-binary-copy\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40529acc-e965-45c3-8af8-7f9d7d80d319-tmp\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207195 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-etc-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysconfig\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207399 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-cni-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207386 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207431 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-tuned\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-netns\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207538 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-kubelet\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207574 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-etc-kubernetes\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207594 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-cni-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207619 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-ovn\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207641 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-kubelet\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207643 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210025 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-env-overrides\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207684 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-daemon-config\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovnkube-script-lib\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207735 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-etc-kubernetes\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207781 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-ovn\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207772 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-netns\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21f50472-ba9e-48d4-b268-c936e6062594-iptables-alerter-script\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.207875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-system-cni-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.207956 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:05.210795 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.208006 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:05.707987549 +0000 UTC m=+3.013472150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-systemd\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8bnd\" (UniqueName: \"kubernetes.io/projected/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-kube-api-access-x8bnd\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40354d1e-f46b-4d14-a595-cf1e198a7d0d-agent-certs\") pod \"konnectivity-agent-8mmjw\" (UID: \"40354d1e-f46b-4d14-a595-cf1e198a7d0d\") " pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208117 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-systemd\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whfbh\" (UniqueName: \"kubernetes.io/projected/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-kube-api-access-whfbh\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208167 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-system-cni-dir\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d57cce7-ddc8-47f9-9abb-307d0125974d-kubelet-config\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-socket-dir-parent\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-env-overrides\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-var-lib-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211354 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-var-lib-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208331 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-node-log\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-lib-modules\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-node-log\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208376 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-daemon-config\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac160e25-d0ef-4276-9d27-654476ec96a2-cni-binary-copy\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208422 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-multus-socket-dir-parent\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208425 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-cni-multus\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-registration-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-lib-modules\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208499 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-var-lib-cni-multus\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-registration-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-os-release\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208554 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d57cce7-ddc8-47f9-9abb-307d0125974d-kubelet-config\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.211803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208585 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-socket-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208611 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovnkube-config\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22494f3d-9978-4b22-8ea6-4582900753e4-serviceca\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208764 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-os-release\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xkv2\" (UniqueName: \"kubernetes.io/projected/22494f3d-9978-4b22-8ea6-4582900753e4-kube-api-access-4xkv2\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5cq\" (UniqueName: \"kubernetes.io/projected/2b1e6f79-37c1-4239-89e0-744d9e2a5862-kube-api-access-fm5cq\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysctl-d\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcxf\" (UniqueName: \"kubernetes.io/projected/40529acc-e965-45c3-8af8-7f9d7d80d319-kube-api-access-gtcxf\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-k8s-cni-cncf-io\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208940 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-cni-bin\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysctl-conf\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.208990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-sys\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-os-release\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209049 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22494f3d-9978-4b22-8ea6-4582900753e4-serviceca\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.212238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wdmn\" (UniqueName: \"kubernetes.io/projected/ac160e25-d0ef-4276-9d27-654476ec96a2-kube-api-access-2wdmn\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209084 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209110 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d57cce7-ddc8-47f9-9abb-307d0125974d-dbus\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209152 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-socket-dir\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cnibin\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209189 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-var-lib-kubelet\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-host\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-multus-certs\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209266 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac160e25-d0ef-4276-9d27-654476ec96a2-cni-binary-copy\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-run-netns\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b1e6f79-37c1-4239-89e0-744d9e2a5862-hosts-file\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209346 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-sys\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209382 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b1e6f79-37c1-4239-89e0-744d9e2a5862-hosts-file\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-os-release\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-var-lib-kubelet\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.212701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-run-openvswitch\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209635 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d57cce7-ddc8-47f9-9abb-307d0125974d-dbus\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209679 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-cnibin\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-multus-certs\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209719 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-host\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209791 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-run-netns\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysctl-d\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-host-cni-bin\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.209995 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac160e25-d0ef-4276-9d27-654476ec96a2-host-run-k8s-cni-cncf-io\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.210100 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-sysctl-conf\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.210455 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovnkube-config\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.211294 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40529acc-e965-45c3-8af8-7f9d7d80d319-etc-tuned\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.211340 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40529acc-e965-45c3-8af8-7f9d7d80d319-tmp\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.211411 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-ovn-node-metrics-cert\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.213176 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.211490 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40354d1e-f46b-4d14-a595-cf1e198a7d0d-agent-certs\") pod \"konnectivity-agent-8mmjw\" (UID: \"40354d1e-f46b-4d14-a595-cf1e198a7d0d\") " pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.223922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.223896 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjvpq\" (UniqueName: \"kubernetes.io/projected/21f50472-ba9e-48d4-b268-c936e6062594-kube-api-access-hjvpq\") pod \"iptables-alerter-pjnsv\" (UID: \"21f50472-ba9e-48d4-b268-c936e6062594\") " pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.224415 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.224394 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krw5k\" (UniqueName: \"kubernetes.io/projected/7ee4c1e6-74ed-467b-ad97-9b1a5389908f-kube-api-access-krw5k\") pod \"ovnkube-node-n7vwl\" (UID: \"7ee4c1e6-74ed-467b-ad97-9b1a5389908f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.225825 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.225804 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:05.225908 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.225830 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:05.225908 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.225845 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:05.226031 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.225912 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:05.725894068 +0000 UTC m=+3.031378709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:05.226298 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.226280 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xkv2\" (UniqueName: \"kubernetes.io/projected/22494f3d-9978-4b22-8ea6-4582900753e4-kube-api-access-4xkv2\") pod \"node-ca-cf2hz\" (UID: \"22494f3d-9978-4b22-8ea6-4582900753e4\") " pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.226427 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.226410 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6269\" (UniqueName: \"kubernetes.io/projected/f1e5629a-4b0d-4b2a-9074-20eeb9329dbd-kube-api-access-n6269\") pod \"aws-ebs-csi-driver-node-vklrw\" (UID: \"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.226485 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.226465 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wdmn\" (UniqueName: \"kubernetes.io/projected/ac160e25-d0ef-4276-9d27-654476ec96a2-kube-api-access-2wdmn\") pod \"multus-q895n\" (UID: \"ac160e25-d0ef-4276-9d27-654476ec96a2\") " pod="openshift-multus/multus-q895n" Jul 07 16:35:05.226636 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.226618 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5cq\" (UniqueName: \"kubernetes.io/projected/2b1e6f79-37c1-4239-89e0-744d9e2a5862-kube-api-access-fm5cq\") pod \"node-resolver-vz7rh\" (UID: \"2b1e6f79-37c1-4239-89e0-744d9e2a5862\") " pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.227299 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.227280 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whfbh\" (UniqueName: \"kubernetes.io/projected/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-kube-api-access-whfbh\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.227436 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.227421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcxf\" (UniqueName: \"kubernetes.io/projected/40529acc-e965-45c3-8af8-7f9d7d80d319-kube-api-access-gtcxf\") pod \"tuned-ntvlj\" (UID: \"40529acc-e965-45c3-8af8-7f9d7d80d319\") " pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.231884 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.231862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8bnd\" (UniqueName: \"kubernetes.io/projected/947bef53-3ed7-47b5-b17a-b5f1fe3f9288-kube-api-access-x8bnd\") pod \"multus-additional-cni-plugins-rccks\" (UID: \"947bef53-3ed7-47b5-b17a-b5f1fe3f9288\") " pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.286294 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.286244 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerStarted","Data":"b02eccef2dd4a46e27f63f5152e3358be692f08f62b580391d970656abca75fd"} Jul 07 16:35:05.287478 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.287451 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" event={"ID":"684e505a654ab219cfa598f20931a3ab","Type":"ContainerStarted","Data":"a12d8cebbd067cfb51c5b420b2416a4d9b1c96a781830c53d719c95364c17ea4"} Jul 07 16:35:05.299154 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.299134 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:35:05.385891 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.385827 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:05.391003 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.390933 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" Jul 07 16:35:05.393996 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.393970 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40354d1e_f46b_4d14_a595_cf1e198a7d0d.slice/crio-f41c6c10825b314957e547746a4d21b5d11fa4e8ba7717ad099d93e7adaa6299 WatchSource:0}: Error finding container f41c6c10825b314957e547746a4d21b5d11fa4e8ba7717ad099d93e7adaa6299: Status 404 returned error can't find the container with id f41c6c10825b314957e547746a4d21b5d11fa4e8ba7717ad099d93e7adaa6299 Jul 07 16:35:05.398654 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.398470 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q895n" Jul 07 16:35:05.400528 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.400503 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40529acc_e965_45c3_8af8_7f9d7d80d319.slice/crio-71932ae1438bdb2409afd1727bbbeabe571ad1b7fe849b1500cbd21cca4cd052 WatchSource:0}: Error finding container 71932ae1438bdb2409afd1727bbbeabe571ad1b7fe849b1500cbd21cca4cd052: Status 404 returned error can't find the container with id 71932ae1438bdb2409afd1727bbbeabe571ad1b7fe849b1500cbd21cca4cd052 Jul 07 16:35:05.402052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.401891 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:05.408765 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.408733 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cf2hz" Jul 07 16:35:05.410736 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.410655 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac160e25_d0ef_4276_9d27_654476ec96a2.slice/crio-da22f315a9e830e9a27eff1872f43f02a1c76ac0f36f051b5770cb5dbe78e487 WatchSource:0}: Error finding container da22f315a9e830e9a27eff1872f43f02a1c76ac0f36f051b5770cb5dbe78e487: Status 404 returned error can't find the container with id da22f315a9e830e9a27eff1872f43f02a1c76ac0f36f051b5770cb5dbe78e487 Jul 07 16:35:05.414330 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.414309 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vz7rh" Jul 07 16:35:05.414756 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.414726 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee4c1e6_74ed_467b_ad97_9b1a5389908f.slice/crio-ea7e8e16c623c90fe32804a587442332dc353636857801df75928ac7c4ed537f WatchSource:0}: Error finding container ea7e8e16c623c90fe32804a587442332dc353636857801df75928ac7c4ed537f: Status 404 returned error can't find the container with id ea7e8e16c623c90fe32804a587442332dc353636857801df75928ac7c4ed537f Jul 07 16:35:05.419542 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.419500 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22494f3d_9978_4b22_8ea6_4582900753e4.slice/crio-40be70cf7649a8ccbb47778ba439f737f8d1d5ca31ecebb5ce56d9f839a849a5 WatchSource:0}: Error finding container 40be70cf7649a8ccbb47778ba439f737f8d1d5ca31ecebb5ce56d9f839a849a5: Status 404 returned error can't find the container with id 40be70cf7649a8ccbb47778ba439f737f8d1d5ca31ecebb5ce56d9f839a849a5 Jul 07 16:35:05.423117 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.423089 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rccks" Jul 07 16:35:05.426678 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.426654 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1e6f79_37c1_4239_89e0_744d9e2a5862.slice/crio-9f19d67f27f2aa1ea4c7b36e9be9fbb13e1bf55be1ca09f117a9745294e003a8 WatchSource:0}: Error finding container 9f19d67f27f2aa1ea4c7b36e9be9fbb13e1bf55be1ca09f117a9745294e003a8: Status 404 returned error can't find the container with id 9f19d67f27f2aa1ea4c7b36e9be9fbb13e1bf55be1ca09f117a9745294e003a8 Jul 07 16:35:05.428587 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.428571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pjnsv" Jul 07 16:35:05.432650 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.432616 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947bef53_3ed7_47b5_b17a_b5f1fe3f9288.slice/crio-a217acfc49db067dd9cec06de8e211c4c1fa43ecfc06a69bb413eb1b5dc2d429 WatchSource:0}: Error finding container a217acfc49db067dd9cec06de8e211c4c1fa43ecfc06a69bb413eb1b5dc2d429: Status 404 returned error can't find the container with id a217acfc49db067dd9cec06de8e211c4c1fa43ecfc06a69bb413eb1b5dc2d429 Jul 07 16:35:05.433336 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.433311 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" Jul 07 16:35:05.438895 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.438871 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f50472_ba9e_48d4_b268_c936e6062594.slice/crio-bb06b99611ed431256e1f5a57971571a3a0380349cd5b769250015245d03d4d4 WatchSource:0}: Error finding container bb06b99611ed431256e1f5a57971571a3a0380349cd5b769250015245d03d4d4: Status 404 returned error can't find the container with id bb06b99611ed431256e1f5a57971571a3a0380349cd5b769250015245d03d4d4 Jul 07 16:35:05.443860 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:05.443832 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e5629a_4b0d_4b2a_9074_20eeb9329dbd.slice/crio-bd025bf544af6f17276d4d67dc6f2b8097ad3b92bcc42e36505627d743690dd7 WatchSource:0}: Error finding container bd025bf544af6f17276d4d67dc6f2b8097ad3b92bcc42e36505627d743690dd7: Status 404 returned error can't find the container with id bd025bf544af6f17276d4d67dc6f2b8097ad3b92bcc42e36505627d743690dd7 Jul 07 16:35:05.712924 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.712895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:05.713108 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.712970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:05.713108 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.713092 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:05.713236 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.713112 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:05.713236 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.713173 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:06.71315271 +0000 UTC m=+4.018637327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:05.713236 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.713196 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:35:06.713186429 +0000 UTC m=+4.018671033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:05.814381 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:05.814342 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:05.814657 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.814632 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:05.814743 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.814661 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:05.814743 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.814676 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:05.814866 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:05.814746 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:06.814725814 +0000 UTC m=+4.120210453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:06.138052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.137962 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:30:05 +0000 UTC" deadline="2028-03-02 16:39:29.570808729 +0000 UTC" Jul 07 16:35:06.138052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.138000 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14496h4m23.432814232s" Jul 07 16:35:06.290838 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.290805 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8mmjw" event={"ID":"40354d1e-f46b-4d14-a595-cf1e198a7d0d","Type":"ContainerStarted","Data":"f41c6c10825b314957e547746a4d21b5d11fa4e8ba7717ad099d93e7adaa6299"} Jul 07 16:35:06.292459 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.292433 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pjnsv" event={"ID":"21f50472-ba9e-48d4-b268-c936e6062594","Type":"ContainerStarted","Data":"bb06b99611ed431256e1f5a57971571a3a0380349cd5b769250015245d03d4d4"} Jul 07 16:35:06.293725 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.293703 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerStarted","Data":"a217acfc49db067dd9cec06de8e211c4c1fa43ecfc06a69bb413eb1b5dc2d429"} Jul 07 16:35:06.294951 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.294925 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q895n" event={"ID":"ac160e25-d0ef-4276-9d27-654476ec96a2","Type":"ContainerStarted","Data":"da22f315a9e830e9a27eff1872f43f02a1c76ac0f36f051b5770cb5dbe78e487"} Jul 07 16:35:06.296240 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.296213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" event={"ID":"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd","Type":"ContainerStarted","Data":"bd025bf544af6f17276d4d67dc6f2b8097ad3b92bcc42e36505627d743690dd7"} Jul 07 16:35:06.298832 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.298808 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vz7rh" event={"ID":"2b1e6f79-37c1-4239-89e0-744d9e2a5862","Type":"ContainerStarted","Data":"9f19d67f27f2aa1ea4c7b36e9be9fbb13e1bf55be1ca09f117a9745294e003a8"} Jul 07 16:35:06.303746 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.303700 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cf2hz" event={"ID":"22494f3d-9978-4b22-8ea6-4582900753e4","Type":"ContainerStarted","Data":"40be70cf7649a8ccbb47778ba439f737f8d1d5ca31ecebb5ce56d9f839a849a5"} Jul 07 16:35:06.310012 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.309980 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"ea7e8e16c623c90fe32804a587442332dc353636857801df75928ac7c4ed537f"} Jul 07 16:35:06.311163 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.311138 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" event={"ID":"40529acc-e965-45c3-8af8-7f9d7d80d319","Type":"ContainerStarted","Data":"71932ae1438bdb2409afd1727bbbeabe571ad1b7fe849b1500cbd21cca4cd052"} Jul 07 16:35:06.697789 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.697753 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:35:06.725816 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.725771 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:06.725955 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.725836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:06.726014 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.725988 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:06.726085 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.726047 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:08.726028078 +0000 UTC m=+6.031512687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:06.726442 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.726420 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:06.726505 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.726479 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:35:08.726463237 +0000 UTC m=+6.031947843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:06.827912 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:06.827220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:06.827912 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.827430 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:06.827912 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.827450 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:06.827912 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.827462 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:06.827912 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:06.827517 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:08.827499047 +0000 UTC m=+6.132983655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:07.138994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:07.138652 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:30:05 +0000 UTC" deadline="2028-04-01 07:23:41.732681856 +0000 UTC" Jul 07 16:35:07.138994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:07.138943 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15206h48m34.593743979s" Jul 07 16:35:07.282866 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:07.282833 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:07.283030 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:07.282979 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:07.283482 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:07.283448 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:07.283586 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:07.283565 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:07.283691 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:07.283654 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:07.283762 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:07.283742 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:07.324975 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:07.324942 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerStarted","Data":"54f7906c567469949482bc550ea6f339ce0356b6e0e80f6b2319f4e58c6f6171"} Jul 07 16:35:08.745375 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:08.745334 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:08.745873 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:08.745434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:08.745873 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.745599 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:08.745873 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.745668 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:35:12.745648755 +0000 UTC m=+10.051133363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:08.746114 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.746079 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:08.746196 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.746140 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:12.746121815 +0000 UTC m=+10.051606422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:08.846383 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:08.846348 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:08.846543 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.846506 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:08.846543 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.846526 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:08.846543 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.846542 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:08.846749 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:08.846616 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:12.846597782 +0000 UTC m=+10.152082384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:09.282782 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:09.282748 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:09.282936 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:09.282748 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:09.282936 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:09.282917 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:09.283086 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:09.283038 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:09.283139 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:09.283092 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:09.283186 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:09.283167 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:11.283766 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:11.283714 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:11.284237 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:11.283848 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:11.284307 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:11.284274 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:11.284431 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:11.284377 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:11.285531 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:11.285505 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:11.285653 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:11.285623 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:11.336173 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:11.336142 2555 generic.go:356] "Generic (PLEG): container finished" podID="ddbd14da7139adf25758f98178d8d0ef" containerID="54f7906c567469949482bc550ea6f339ce0356b6e0e80f6b2319f4e58c6f6171" exitCode=0 Jul 07 16:35:11.336319 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:11.336192 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerDied","Data":"54f7906c567469949482bc550ea6f339ce0356b6e0e80f6b2319f4e58c6f6171"} Jul 07 16:35:12.780785 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:12.780738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:12.781274 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:12.780802 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:12.781274 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.780905 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:12.781274 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.780976 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:20.780954645 +0000 UTC m=+18.086439262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:12.781274 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.780907 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:12.781274 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.781042 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:35:20.781026181 +0000 UTC m=+18.086510805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:12.881902 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:12.881872 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:12.882062 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.882025 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:12.882062 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.882052 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:12.882176 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.882068 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:12.882176 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:12.882114 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:20.882100407 +0000 UTC m=+18.187585009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:13.284487 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:13.283741 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:13.284487 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:13.283890 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:13.284487 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:13.284315 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:13.284487 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:13.284437 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:13.285299 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:13.284927 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:13.285299 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:13.285080 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:15.282100 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:15.282071 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:15.282592 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:15.282054 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:15.282592 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:15.282193 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:15.282592 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:15.282237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:15.282592 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:15.282322 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:15.282592 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:15.282401 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:17.282423 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.282394 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:17.282423 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.282428 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:17.282952 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.282392 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:17.282952 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:17.282515 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:17.282952 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:17.282621 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:17.282952 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:17.282691 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:17.349570 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.349511 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" event={"ID":"40529acc-e965-45c3-8af8-7f9d7d80d319","Type":"ContainerStarted","Data":"ef2887c6814e57df7a75c0f935c30687be4663c4322bbd417dbc1c2cc0902aef"} Jul 07 16:35:17.351457 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.351427 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8mmjw" event={"ID":"40354d1e-f46b-4d14-a595-cf1e198a7d0d","Type":"ContainerStarted","Data":"51bd55f2c01177b7981f83ef9df48f53d41cac9da5ca051b1592cd2356b7ebf1"} Jul 07 16:35:17.353676 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.353650 2555 generic.go:356] "Generic (PLEG): container finished" podID="947bef53-3ed7-47b5-b17a-b5f1fe3f9288" containerID="c2eabd7c7ae0fdda43bf1b9bee076c2cf6e1b9908676308ea254a9bd7c5c0b40" exitCode=0 Jul 07 16:35:17.353777 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.353759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerDied","Data":"c2eabd7c7ae0fdda43bf1b9bee076c2cf6e1b9908676308ea254a9bd7c5c0b40"} Jul 07 16:35:17.356120 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.356087 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerStarted","Data":"9634bad0b5c792aae0283345999e9a105477548632e85756b4b02b1a19d8e001"} Jul 07 16:35:17.357938 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.357916 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" event={"ID":"684e505a654ab219cfa598f20931a3ab","Type":"ContainerStarted","Data":"94d4acbf9ede9dbb3ca6de91f2a020c60dea6c2b4cc9bff5b9221e376dd728e5"} Jul 07 16:35:17.359718 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.359651 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" event={"ID":"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd","Type":"ContainerStarted","Data":"cc9355b1c680e725742d227b13dd4da069ba5b6eee7866137173e02ec7e9f7d1"} Jul 07 16:35:17.361223 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.361198 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vz7rh" event={"ID":"2b1e6f79-37c1-4239-89e0-744d9e2a5862","Type":"ContainerStarted","Data":"44705bf6715a76a947fcacd839437199c87f44ad90d91127ddea7471e2b12fb4"} Jul 07 16:35:17.363505 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.363474 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cf2hz" event={"ID":"22494f3d-9978-4b22-8ea6-4582900753e4","Type":"ContainerStarted","Data":"a54dbbfc0f5130db7385d966092f58a472aa1914073ff8506cfdc73e5fcb8355"} Jul 07 16:35:17.371867 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.371827 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ntvlj" podStartSLOduration=1.941375083 podStartE2EDuration="13.371815627s" totalImagesPullingTime="11.430440544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:17.371669257 +0000 UTC m=+14.677153904" watchObservedRunningTime="2026-07-07 16:35:17.371815627 +0000 UTC m=+14.677300252" Jul 07 16:35:17.391242 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.391197 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8mmjw" podStartSLOduration=2.224107531 podStartE2EDuration="13.391179378s" totalImagesPullingTime="11.167071847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:17.390479102 +0000 UTC m=+14.695963743" watchObservedRunningTime="2026-07-07 16:35:17.391179378 +0000 UTC m=+14.696664006" Jul 07 16:35:17.435160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.435111 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" podStartSLOduration=12.435095661 podStartE2EDuration="12.435095661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:17.434849103 +0000 UTC m=+14.740333750" watchObservedRunningTime="2026-07-07 16:35:17.435095661 +0000 UTC m=+14.740580284" Jul 07 16:35:17.457709 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.457628 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cf2hz" podStartSLOduration=2.295553225 podStartE2EDuration="13.457612372s" totalImagesPullingTime="11.162059147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:17.457252718 +0000 UTC m=+14.762737362" watchObservedRunningTime="2026-07-07 16:35:17.457612372 +0000 UTC m=+14.763096995" Jul 07 16:35:17.488189 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.488147 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vz7rh" podStartSLOduration=2.3529583179999998 podStartE2EDuration="13.488131614s" totalImagesPullingTime="11.135173296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:17.487758302 +0000 UTC m=+14.793242940" watchObservedRunningTime="2026-07-07 16:35:17.488131614 +0000 UTC m=+14.793616240" Jul 07 16:35:17.516610 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:17.516570 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" podStartSLOduration=12.516563477 podStartE2EDuration="12.516563477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:17.516562519 +0000 UTC m=+14.822047159" watchObservedRunningTime="2026-07-07 16:35:17.516563477 +0000 UTC m=+14.822048099" Jul 07 16:35:18.367402 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:18.367367 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pjnsv" event={"ID":"21f50472-ba9e-48d4-b268-c936e6062594","Type":"ContainerStarted","Data":"6a46e9d08c5b47cbca99746e5dcd4f244c49040c8881c15a59e9ae37dc5bd7ea"} Jul 07 16:35:18.389798 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:18.389751 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pjnsv" podStartSLOduration=3.246234942 podStartE2EDuration="14.389731022s" totalImagesPullingTime="11.14349608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:18.38966738 +0000 UTC m=+15.695152005" watchObservedRunningTime="2026-07-07 16:35:18.389731022 +0000 UTC m=+15.695215645" Jul 07 16:35:19.281993 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:19.281965 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:19.282195 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:19.282088 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:19.282195 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:19.281963 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:19.282195 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:19.282179 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:19.282195 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:19.281963 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:19.282409 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:19.282250 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:19.501287 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:19.501232 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:19.502112 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:19.502090 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:20.021199 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:20.021170 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:20.021749 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:20.021720 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8mmjw" Jul 07 16:35:20.843743 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:20.843701 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:20.844312 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:20.843790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:20.844312 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.843839 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:20.844312 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.844160 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:36.844044701 +0000 UTC m=+34.149529318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:20.844312 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.844231 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:20.844312 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.844302 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:35:36.844276976 +0000 UTC m=+34.149761577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:20.944359 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:20.944328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:20.944544 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.944459 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:20.944544 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.944477 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:20.944544 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.944488 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:20.944712 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:20.944557 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:36.944539372 +0000 UTC m=+34.250023991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:21.282613 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:21.282582 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:21.282613 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:21.282601 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:21.282850 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:21.282585 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:21.282850 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:21.282697 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:21.282850 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:21.282791 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:21.282998 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:21.282897 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:23.283217 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:23.283185 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:23.283986 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:23.283309 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:23.283986 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:23.283895 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:23.284107 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:23.283993 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:23.284107 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:23.284032 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:23.284107 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:23.284092 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:25.282170 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:25.282133 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:25.282768 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:25.282134 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:25.282768 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:25.282265 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:25.282768 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:25.282281 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:25.282768 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:25.282397 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:25.282768 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:25.282493 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:27.281905 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:27.281872 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:27.281905 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:27.281888 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:27.282397 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:27.281873 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:27.282397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:27.282003 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:27.282397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:27.282072 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:27.282397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:27.282139 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:28.693402 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:28.693279 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:35:29.158658 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.158578 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:35:28.69340075Z","UUID":"c581c114-0f60-48d5-84ec-73e5aa6360f9","Handler":null,"Name":"","Endpoint":""} Jul 07 16:35:29.159841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.159825 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:35:29.159919 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.159855 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:35:29.282297 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.282272 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:29.282429 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.282272 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:29.282429 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:29.282376 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:29.282429 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.282397 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:29.282587 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:29.282482 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:29.282636 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:29.282607 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:29.389160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.389096 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" event={"ID":"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd","Type":"ContainerStarted","Data":"588c428bfd6efb910fcd8a379b4273432fd41c66246aaab2682ca6fcf58fe2f7"} Jul 07 16:35:29.391704 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.391681 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"f1f75f346f6c9bf657334fcf13d1052bf0952590cb0dbcd5b25b14f77d98ae2d"} Jul 07 16:35:29.391818 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.391746 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"72d7b145dea581ee67186ee8c77288c5a2e370feb70c269276a73357dbe7a219"} Jul 07 16:35:29.391818 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.391778 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"a5ecbf011d4a84b6d3e33af20dfadfb16d57c0d06fb96e9e465d6e5425437ee6"} Jul 07 16:35:29.391898 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.391820 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"f2c04c5909dffbe5d96d225e95c9142e465982188f1af7d304da86163ab130fd"} Jul 07 16:35:29.391898 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.391848 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"cae584f841ffe101178118e194ca630531b6de8e0382daff9f68edfbedb7e4af"} Jul 07 16:35:29.391898 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.391883 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"b569afc7177d6c3b96afef88926925b80b32b07f2aef50a7db1026bf528bc605"} Jul 07 16:35:29.393308 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.393290 2555 generic.go:356] "Generic (PLEG): container finished" podID="947bef53-3ed7-47b5-b17a-b5f1fe3f9288" containerID="64c6cfbcf00479c4403d32014cd047dc0548d4808344d7626ad3bf9fe6f3e312" exitCode=0 Jul 07 16:35:29.393385 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.393325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerDied","Data":"64c6cfbcf00479c4403d32014cd047dc0548d4808344d7626ad3bf9fe6f3e312"} Jul 07 16:35:29.394809 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.394706 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q895n" event={"ID":"ac160e25-d0ef-4276-9d27-654476ec96a2","Type":"ContainerStarted","Data":"135b7c0a95b9408ce30226b2d68204818794d3db6a27bab9f0d5dfe8f98ecef2"} Jul 07 16:35:29.444957 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:29.444921 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q895n" podStartSLOduration=2.307694126 podStartE2EDuration="25.444910856s" totalImagesPullingTime="23.13721673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:29.444740676 +0000 UTC m=+26.750225299" watchObservedRunningTime="2026-07-07 16:35:29.444910856 +0000 UTC m=+26.750395477" Jul 07 16:35:31.282679 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.282656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:31.283167 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.282656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:31.283167 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.282765 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:31.283167 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:31.282766 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:31.283167 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:31.282873 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:31.283167 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:31.282935 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:31.400633 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.400608 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" event={"ID":"f1e5629a-4b0d-4b2a-9074-20eeb9329dbd","Type":"ContainerStarted","Data":"55444e8b936180bb43c114502eae0cc32d1549cdb0535c296644b132b6a01ef9"} Jul 07 16:35:31.404152 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.404126 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"562a486266948fa45e1c12984a4be02a13780238e81c5cf94394021dec79d98c"} Jul 07 16:35:31.406433 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.406410 2555 generic.go:356] "Generic (PLEG): container finished" podID="947bef53-3ed7-47b5-b17a-b5f1fe3f9288" containerID="155529bcabb975de2e0e9c6ef6f6dfbbf4c42cece373c9b28a83480208e14a93" exitCode=0 Jul 07 16:35:31.406629 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.406446 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerDied","Data":"155529bcabb975de2e0e9c6ef6f6dfbbf4c42cece373c9b28a83480208e14a93"} Jul 07 16:35:31.425727 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:31.425690 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vklrw" podStartSLOduration=2.682244923 podStartE2EDuration="27.425676668s" totalImagesPullingTime="24.743431745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:31.425569396 +0000 UTC m=+28.731054036" watchObservedRunningTime="2026-07-07 16:35:31.425676668 +0000 UTC m=+28.731161289" Jul 07 16:35:33.283152 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:33.283120 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:33.283730 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:33.283217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:33.283730 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:33.283258 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:33.283730 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:33.283255 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:33.283730 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:33.283332 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:33.283730 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:33.283450 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:33.412205 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:33.412180 2555 generic.go:356] "Generic (PLEG): container finished" podID="947bef53-3ed7-47b5-b17a-b5f1fe3f9288" containerID="34ce7fe19caa768de328c8de98c85fbd06e3c08728992ff5652995b70822d67a" exitCode=0 Jul 07 16:35:33.412334 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:33.412217 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerDied","Data":"34ce7fe19caa768de328c8de98c85fbd06e3c08728992ff5652995b70822d67a"} Jul 07 16:35:34.420836 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:34.420660 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" event={"ID":"7ee4c1e6-74ed-467b-ad97-9b1a5389908f","Type":"ContainerStarted","Data":"9025e16e84e82a15f731aefab00026ed6cda0475389c37702ad6af9bf07ca5d9"} Jul 07 16:35:34.421387 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:34.420893 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:34.421387 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:34.420929 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:34.435931 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:34.435909 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:34.461396 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:34.461356 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" podStartSLOduration=7.291836797 podStartE2EDuration="30.461344014s" totalImagesPullingTime="23.169507217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:34.460801832 +0000 UTC m=+31.766286454" watchObservedRunningTime="2026-07-07 16:35:34.461344014 +0000 UTC m=+31.766828635" Jul 07 16:35:35.282008 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.281977 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:35.282008 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.282012 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:35.282231 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.281977 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:35.282231 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:35.282096 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:35.282231 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:35.282152 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:35.282231 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:35.282224 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:35.423495 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.423469 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:35.439927 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.439904 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:35:35.651101 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.651022 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jqvn"] Jul 07 16:35:35.651246 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.651127 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:35.651312 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:35.651292 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:35.659225 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.659184 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s785t"] Jul 07 16:35:35.659343 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.659283 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:35.659419 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:35.659386 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:35.660736 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.660697 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6gt9j"] Jul 07 16:35:35.660841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:35.660778 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:35.660917 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:35.660857 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:36.865230 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:36.865154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:36.865230 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:36.865226 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:36.865691 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.865361 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:36.865691 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.865407 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:36.865691 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.865435 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret podName:9d57cce7-ddc8-47f9-9abb-307d0125974d nodeName:}" failed. No retries permitted until 2026-07-07 16:36:08.865414337 +0000 UTC m=+66.170898940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret") pod "global-pull-secret-syncer-7jqvn" (UID: "9d57cce7-ddc8-47f9-9abb-307d0125974d") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:35:36.865691 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.865462 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs podName:0703ddfb-7bf8-4e55-9f94-5cdb46f21879 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:08.865445596 +0000 UTC m=+66.170930199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs") pod "network-metrics-daemon-s785t" (UID: "0703ddfb-7bf8-4e55-9f94-5cdb46f21879") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:35:36.966148 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:36.966120 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:36.966291 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.966268 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:35:36.966291 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.966284 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:35:36.966374 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.966294 2555 projected.go:196] Error preparing data for projected volume kube-api-access-cbz67 for pod openshift-network-diagnostics/network-check-target-6gt9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:36.966374 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:36.966337 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67 podName:ee5f53e4-c461-41bb-a77f-739f74bb4d23 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:08.966325399 +0000 UTC m=+66.271810003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbz67" (UniqueName: "kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67") pod "network-check-target-6gt9j" (UID: "ee5f53e4-c461-41bb-a77f-739f74bb4d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:35:37.282432 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:37.282396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:37.282624 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:37.282398 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:37.282624 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:37.282510 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:37.282624 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:37.282538 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:37.282624 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:37.282612 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:37.282791 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:37.282689 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:39.282052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:39.282022 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:39.282491 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:39.282026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:39.282491 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:39.282152 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:39.282491 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:39.282035 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:39.282491 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:39.282221 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:39.282491 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:39.282269 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:40.437578 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:40.437395 2555 generic.go:356] "Generic (PLEG): container finished" podID="947bef53-3ed7-47b5-b17a-b5f1fe3f9288" containerID="42620e09ae325deec72c1b5998105e1d9c03e63cc1aa4cb10e306861904d1d2a" exitCode=0 Jul 07 16:35:40.437578 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:40.437480 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerDied","Data":"42620e09ae325deec72c1b5998105e1d9c03e63cc1aa4cb10e306861904d1d2a"} Jul 07 16:35:41.282466 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.282391 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:41.282601 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.282391 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:41.282601 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.282502 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gt9j" podUID="ee5f53e4-c461-41bb-a77f-739f74bb4d23" Jul 07 16:35:41.282601 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.282517 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:41.282717 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.282630 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s785t" podUID="0703ddfb-7bf8-4e55-9f94-5cdb46f21879" Jul 07 16:35:41.282717 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.282706 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jqvn" podUID="9d57cce7-ddc8-47f9-9abb-307d0125974d" Jul 07 16:35:41.442413 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.442384 2555 generic.go:356] "Generic (PLEG): container finished" podID="947bef53-3ed7-47b5-b17a-b5f1fe3f9288" containerID="799867d2546b0d930bab3d6900e07991b04d62ad8acf845870d46f43e5ea7f08" exitCode=0 Jul 07 16:35:41.442923 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.442423 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerDied","Data":"799867d2546b0d930bab3d6900e07991b04d62ad8acf845870d46f43e5ea7f08"} Jul 07 16:35:41.498203 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.498185 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeReady" Jul 07 16:35:41.498310 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.498273 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:35:41.560263 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.560241 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-698cf5c9bd-4t7jl"] Jul 07 16:35:41.569981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.569965 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h"] Jul 07 16:35:41.570085 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.570072 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.576540 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.576504 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7xrgf\"" Jul 07 16:35:41.576790 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.576775 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 16:35:41.577375 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.577359 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 16:35:41.577431 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.577420 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 16:35:41.584448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.584430 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hlxnk"] Jul 07 16:35:41.584546 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.584517 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.593669 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.593652 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:35:41.593817 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.593800 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 16:35:41.593926 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.593914 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:35:41.595364 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.595348 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r68cw\"" Jul 07 16:35:41.595436 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.595403 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 16:35:41.596980 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.596962 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5779866cb7-wjhtf"] Jul 07 16:35:41.597067 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.597057 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.606186 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.606165 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 16:35:41.608021 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.608003 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h"] Jul 07 16:35:41.608131 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.608116 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.627100 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627079 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qx445\"" Jul 07 16:35:41.627100 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627090 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 16:35:41.627246 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627110 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2bxnf\"" Jul 07 16:35:41.627246 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627180 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 16:35:41.627246 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627200 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 16:35:41.627489 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627467 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 16:35:41.627605 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627511 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 16:35:41.627742 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627727 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 16:35:41.627816 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627769 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 16:35:41.627816 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627798 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:35:41.627958 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.627945 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:35:41.628072 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.628026 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 16:35:41.629742 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.629725 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-698cf5c9bd-4t7jl"] Jul 07 16:35:41.664184 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.664167 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5779866cb7-wjhtf"] Jul 07 16:35:41.664734 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.664714 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hlxnk"] Jul 07 16:35:41.665879 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.665862 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 16:35:41.690642 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.690625 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gbpt9"] Jul 07 16:35:41.700010 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.699992 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:41.704564 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-bound-sa-token\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.704673 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-serving-cert\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.704673 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.704673 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704639 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-registry-certificates\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.704673 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-snapshots\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.704841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704686 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbdt\" (UniqueName: \"kubernetes.io/projected/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-kube-api-access-2nbdt\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.704841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704740 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.704841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704761 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.704841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhc8w\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-kube-api-access-hhc8w\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.704841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-trusted-ca\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gkqr\" (UniqueName: \"kubernetes.io/projected/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-kube-api-access-2gkqr\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-installation-pull-secrets\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-image-registry-private-configuration\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29907fbb-7dc2-404b-8e61-95c708baf822-ca-trust-extracted\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.705006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.704980 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-tmp\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.707656 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.707639 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:35:41.707754 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.707704 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:35:41.707794 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.707759 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6hxjn\"" Jul 07 16:35:41.711108 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.711094 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:35:41.748687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.748664 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gbpt9"] Jul 07 16:35:41.749252 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.749211 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qwn9n"] Jul 07 16:35:41.757227 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.757212 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:41.773576 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.773558 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:35:41.773660 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.773642 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:35:41.773779 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.773766 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b7v6b\"" Jul 07 16:35:41.805794 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805750 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-bound-sa-token\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.805794 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805779 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-serving-cert\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l66lr\" (UniqueName: \"kubernetes.io/projected/b83d95e4-4811-4a66-9363-4ae10f29a99e-kube-api-access-l66lr\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-registry-certificates\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-snapshots\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbdt\" (UniqueName: \"kubernetes.io/projected/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-kube-api-access-2nbdt\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.805977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.805974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhc8w\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-kube-api-access-hhc8w\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806031 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-stats-auth\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806060 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-trusted-ca\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806083 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-default-certificate\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806118 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806188 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gkqr\" (UniqueName: \"kubernetes.io/projected/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-kube-api-access-2gkqr\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a66a91-122b-41dd-b912-774a663fbc7f-cert\") pod \"ingress-canary-gbpt9\" (UID: \"06a66a91-122b-41dd-b912-774a663fbc7f\") " pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806239 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs88h\" (UniqueName: \"kubernetes.io/projected/06a66a91-122b-41dd-b912-774a663fbc7f-kube-api-access-vs88h\") pod \"ingress-canary-gbpt9\" (UID: \"06a66a91-122b-41dd-b912-774a663fbc7f\") " pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-installation-pull-secrets\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.806328 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806338 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-image-registry-private-configuration\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806364 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29907fbb-7dc2-404b-8e61-95c708baf822-ca-trust-extracted\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806387 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-tmp\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806422 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806426 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-registry-certificates\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.806457 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.806470 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-698cf5c9bd-4t7jl: secret "image-registry-tls" not found Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806483 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-snapshots\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.806517 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls podName:29907fbb-7dc2-404b-8e61-95c708baf822 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:42.306500516 +0000 UTC m=+39.611985128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls") pod "image-registry-698cf5c9bd-4t7jl" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822") : secret "image-registry-tls" not found Jul 07 16:35:41.806972 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.807447 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.806997 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.807447 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.807191 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-tmp\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.807447 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.807275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29907fbb-7dc2-404b-8e61-95c708baf822-ca-trust-extracted\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.807447 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.807351 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:41.807447 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.807402 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls podName:1fa3e5d2-2429-4d25-9abe-6c7a786f912f nodeName:}" failed. No retries permitted until 2026-07-07 16:35:42.307386027 +0000 UTC m=+39.612870642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vr97h" (UID: "1fa3e5d2-2429-4d25-9abe-6c7a786f912f") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:41.807731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.807478 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.807731 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.807654 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-trusted-ca\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.808840 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.808820 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qwn9n"] Jul 07 16:35:41.810798 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.810752 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-serving-cert\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.810798 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.810758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-installation-pull-secrets\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.810922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.810833 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-image-registry-private-configuration\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.834160 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.834143 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbdt\" (UniqueName: \"kubernetes.io/projected/cbdeb8a8-38dd-465e-a6a9-3c716c98577d-kube-api-access-2nbdt\") pod \"insights-operator-5c847dcfc4-hlxnk\" (UID: \"cbdeb8a8-38dd-465e-a6a9-3c716c98577d\") " pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.859641 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.859618 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-bound-sa-token\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.860695 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.860675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhc8w\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-kube-api-access-hhc8w\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:41.863145 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.863127 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gkqr\" (UniqueName: \"kubernetes.io/projected/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-kube-api-access-2gkqr\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:41.907298 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907281 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" Jul 07 16:35:41.907424 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907373 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l66lr\" (UniqueName: \"kubernetes.io/projected/b83d95e4-4811-4a66-9363-4ae10f29a99e-kube-api-access-l66lr\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.907424 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-config-volume\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:41.907516 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-default-certificate\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.907516 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.907610 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-stats-auth\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.907610 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.907584 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:42.407568885 +0000 UTC m=+39.713053501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : configmap references non-existent config key: service-ca.crt Jul 07 16:35:41.907610 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a66a91-122b-41dd-b912-774a663fbc7f-cert\") pod \"ingress-canary-gbpt9\" (UID: \"06a66a91-122b-41dd-b912-774a663fbc7f\") " pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907644 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-tmp-dir\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz2tv\" (UniqueName: \"kubernetes.io/projected/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-kube-api-access-qz2tv\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.907761 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.907780 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs88h\" (UniqueName: \"kubernetes.io/projected/06a66a91-122b-41dd-b912-774a663fbc7f-kube-api-access-vs88h\") pod \"ingress-canary-gbpt9\" (UID: \"06a66a91-122b-41dd-b912-774a663fbc7f\") " pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:41.907813 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:41.907812 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:42.407796498 +0000 UTC m=+39.713281101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : secret "router-metrics-certs-default" not found Jul 07 16:35:41.909398 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.909379 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-default-certificate\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.909631 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.909612 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-stats-auth\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.909688 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.909677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a66a91-122b-41dd-b912-774a663fbc7f-cert\") pod \"ingress-canary-gbpt9\" (UID: \"06a66a91-122b-41dd-b912-774a663fbc7f\") " pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:41.937293 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.937276 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l66lr\" (UniqueName: \"kubernetes.io/projected/b83d95e4-4811-4a66-9363-4ae10f29a99e-kube-api-access-l66lr\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:41.939054 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:41.939034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs88h\" (UniqueName: \"kubernetes.io/projected/06a66a91-122b-41dd-b912-774a663fbc7f-kube-api-access-vs88h\") pod \"ingress-canary-gbpt9\" (UID: \"06a66a91-122b-41dd-b912-774a663fbc7f\") " pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.008248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-config-volume\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.008305 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gbpt9" Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.008371 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-tmp-dir\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.008397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz2tv\" (UniqueName: \"kubernetes.io/projected/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-kube-api-access-qz2tv\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.008428 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.008582 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:35:42.008716 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.008622 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls podName:33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa nodeName:}" failed. No retries permitted until 2026-07-07 16:35:42.508610227 +0000 UTC m=+39.814094827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls") pod "dns-default-qwn9n" (UID: "33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa") : secret "dns-default-metrics-tls" not found Jul 07 16:35:42.009347 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.009182 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-config-volume\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.009486 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.009441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-tmp-dir\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.032295 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.032105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz2tv\" (UniqueName: \"kubernetes.io/projected/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-kube-api-access-qz2tv\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.097937 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.097909 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hlxnk"] Jul 07 16:35:42.101298 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:42.101273 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbdeb8a8_38dd_465e_a6a9_3c716c98577d.slice/crio-36c87f2b5a6da915ab45a81041b0839cdda90c788d13fb9f7487957c135575a5 WatchSource:0}: Error finding container 36c87f2b5a6da915ab45a81041b0839cdda90c788d13fb9f7487957c135575a5: Status 404 returned error can't find the container with id 36c87f2b5a6da915ab45a81041b0839cdda90c788d13fb9f7487957c135575a5 Jul 07 16:35:42.160588 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.160550 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gbpt9"] Jul 07 16:35:42.163127 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:35:42.163100 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a66a91_122b_41dd_b912_774a663fbc7f.slice/crio-a37b9c6855b0cce95595566da62935b12d778670c2e82237c0de6b1335a75d25 WatchSource:0}: Error finding container a37b9c6855b0cce95595566da62935b12d778670c2e82237c0de6b1335a75d25: Status 404 returned error can't find the container with id a37b9c6855b0cce95595566da62935b12d778670c2e82237c0de6b1335a75d25 Jul 07 16:35:42.310514 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.310487 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:42.310623 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.310551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:42.310671 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.310630 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:35:42.310671 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.310645 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-698cf5c9bd-4t7jl: secret "image-registry-tls" not found Jul 07 16:35:42.310737 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.310687 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:42.310737 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.310697 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls podName:29907fbb-7dc2-404b-8e61-95c708baf822 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:43.310683951 +0000 UTC m=+40.616168552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls") pod "image-registry-698cf5c9bd-4t7jl" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822") : secret "image-registry-tls" not found Jul 07 16:35:42.310812 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.310744 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls podName:1fa3e5d2-2429-4d25-9abe-6c7a786f912f nodeName:}" failed. No retries permitted until 2026-07-07 16:35:43.310731695 +0000 UTC m=+40.616216295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vr97h" (UID: "1fa3e5d2-2429-4d25-9abe-6c7a786f912f") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:42.411046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.410990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:42.411046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.411036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:42.411198 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.411110 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:35:42.411198 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.411143 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:43.411126025 +0000 UTC m=+40.716610647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : configmap references non-existent config key: service-ca.crt Jul 07 16:35:42.411198 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.411170 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:43.411157329 +0000 UTC m=+40.716641929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : secret "router-metrics-certs-default" not found Jul 07 16:35:42.447818 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.447794 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rccks" event={"ID":"947bef53-3ed7-47b5-b17a-b5f1fe3f9288","Type":"ContainerStarted","Data":"9f126d47ba85bfaa63da58887273820061f36d9f1c227fbde7d3180e24a42cef"} Jul 07 16:35:42.448964 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.448942 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gbpt9" event={"ID":"06a66a91-122b-41dd-b912-774a663fbc7f","Type":"ContainerStarted","Data":"a37b9c6855b0cce95595566da62935b12d778670c2e82237c0de6b1335a75d25"} Jul 07 16:35:42.449832 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.449817 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" event={"ID":"cbdeb8a8-38dd-465e-a6a9-3c716c98577d","Type":"ContainerStarted","Data":"36c87f2b5a6da915ab45a81041b0839cdda90c788d13fb9f7487957c135575a5"} Jul 07 16:35:42.490775 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.490738 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rccks" podStartSLOduration=6.789998667 podStartE2EDuration="38.490725385s" totalImagesPullingTime="31.700726718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:42.487501215 +0000 UTC m=+39.792985838" watchObservedRunningTime="2026-07-07 16:35:42.490725385 +0000 UTC m=+39.796210006" Jul 07 16:35:42.511976 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.511954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:42.512105 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.512085 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:35:42.512168 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:42.512150 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls podName:33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa nodeName:}" failed. No retries permitted until 2026-07-07 16:35:43.51213323 +0000 UTC m=+40.817617849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls") pod "dns-default-qwn9n" (UID: "33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa") : secret "dns-default-metrics-tls" not found Jul 07 16:35:42.754242 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.754213 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:42.863586 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:42.863541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:43.283241 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.283211 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:35:43.283423 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.283322 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:35:43.283423 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.283357 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:35:43.288416 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.288396 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:35:43.288573 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.288399 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:35:43.289780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.289760 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:35:43.289780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.289775 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwxng\"" Jul 07 16:35:43.289978 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.289943 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:35:43.290092 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.290020 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9ddt\"" Jul 07 16:35:43.318801 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.318574 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:43.318801 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.318678 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:43.318801 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.318727 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls podName:1fa3e5d2-2429-4d25-9abe-6c7a786f912f nodeName:}" failed. No retries permitted until 2026-07-07 16:35:45.318712868 +0000 UTC m=+42.624197468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vr97h" (UID: "1fa3e5d2-2429-4d25-9abe-6c7a786f912f") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:43.318801 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.318771 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:43.319059 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.318865 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:35:43.319059 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.318878 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-698cf5c9bd-4t7jl: secret "image-registry-tls" not found Jul 07 16:35:43.319059 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.318914 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls podName:29907fbb-7dc2-404b-8e61-95c708baf822 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:45.318901511 +0000 UTC m=+42.624386116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls") pod "image-registry-698cf5c9bd-4t7jl" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822") : secret "image-registry-tls" not found Jul 07 16:35:43.419795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.419772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:43.419923 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.419818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:43.419985 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.419940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:45.419919794 +0000 UTC m=+42.725404414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : configmap references non-existent config key: service-ca.crt Jul 07 16:35:43.419985 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.419945 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:35:43.420080 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.419989 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:45.419976783 +0000 UTC m=+42.725461401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : secret "router-metrics-certs-default" not found Jul 07 16:35:43.520950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:43.520918 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:43.521266 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.521059 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:35:43.521266 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:43.521110 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls podName:33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa nodeName:}" failed. No retries permitted until 2026-07-07 16:35:45.521093393 +0000 UTC m=+42.826577996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls") pod "dns-default-qwn9n" (UID: "33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa") : secret "dns-default-metrics-tls" not found Jul 07 16:35:45.338242 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:45.338209 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:45.338704 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:45.338260 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:45.338704 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.338372 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:45.338704 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.338376 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:35:45.338704 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.338391 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-698cf5c9bd-4t7jl: secret "image-registry-tls" not found Jul 07 16:35:45.338704 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.338445 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls podName:29907fbb-7dc2-404b-8e61-95c708baf822 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:49.338430415 +0000 UTC m=+46.643915023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls") pod "image-registry-698cf5c9bd-4t7jl" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822") : secret "image-registry-tls" not found Jul 07 16:35:45.338704 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.338462 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls podName:1fa3e5d2-2429-4d25-9abe-6c7a786f912f nodeName:}" failed. No retries permitted until 2026-07-07 16:35:49.338454543 +0000 UTC m=+46.643939143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vr97h" (UID: "1fa3e5d2-2429-4d25-9abe-6c7a786f912f") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:45.439624 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:45.439554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:45.439624 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:45.439599 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:45.439786 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.439699 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:35:45.439786 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.439742 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:49.439729615 +0000 UTC m=+46.745214214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : secret "router-metrics-certs-default" not found Jul 07 16:35:45.439869 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.439817 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:49.439804843 +0000 UTC m=+46.745289443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : configmap references non-existent config key: service-ca.crt Jul 07 16:35:45.540773 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:45.540743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:45.540922 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.540904 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:35:45.540986 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:45.540973 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls podName:33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa nodeName:}" failed. No retries permitted until 2026-07-07 16:35:49.540954467 +0000 UTC m=+46.846439276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls") pod "dns-default-qwn9n" (UID: "33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa") : secret "dns-default-metrics-tls" not found Jul 07 16:35:46.329225 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:46.329037 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:46.429635 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:46.429595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:46.463267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:46.463245 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gbpt9" event={"ID":"06a66a91-122b-41dd-b912-774a663fbc7f","Type":"ContainerStarted","Data":"2c317847a219a55ece0d7282a515c14aa3a52adcaa821a61980e8b6a696e8358"} Jul 07 16:35:46.464678 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:46.464658 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" event={"ID":"cbdeb8a8-38dd-465e-a6a9-3c716c98577d","Type":"ContainerStarted","Data":"ee4f4136852a6e29eb8f3e91557c121ef5dfa81c3fc6961edf21792dbbbca56e"} Jul 07 16:35:46.483267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:46.483232 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gbpt9" podStartSLOduration=1.7893202879999999 podStartE2EDuration="5.483217276s" totalImagesPullingTime="3.693896988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:46.482216041 +0000 UTC m=+43.787700660" watchObservedRunningTime="2026-07-07 16:35:46.483217276 +0000 UTC m=+43.788701897" Jul 07 16:35:47.227543 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.227477 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" podStartSLOduration=9.478119073 podStartE2EDuration="13.227458391s" totalImagesPullingTime="3.749339318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:35:46.503949194 +0000 UTC m=+43.809433817" watchObservedRunningTime="2026-07-07 16:35:47.227458391 +0000 UTC m=+44.532943013" Jul 07 16:35:47.228201 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.228180 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bj7kt"] Jul 07 16:35:47.250419 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.250395 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.251746 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.251720 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bj7kt"] Jul 07 16:35:47.257582 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.257346 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:35:47.257582 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.257403 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:35:47.257918 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.257903 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jzqmj\"" Jul 07 16:35:47.311057 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.311033 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:47.353347 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.353323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f6693ac-bbca-4ad0-afb2-00bb8227c767-crio-socket\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.353441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.353351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.353441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.353370 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql86h\" (UniqueName: \"kubernetes.io/projected/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-api-access-ql86h\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.353441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.353400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f6693ac-bbca-4ad0-afb2-00bb8227c767-data-volume\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.353582 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.353455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.413644 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.413621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:47.454753 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.454731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f6693ac-bbca-4ad0-afb2-00bb8227c767-crio-socket\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.454758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.454776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql86h\" (UniqueName: \"kubernetes.io/projected/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-api-access-ql86h\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.454910 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.454963 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:47.954945609 +0000 UTC m=+45.260430223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : configmap "kube-rbac-proxy" not found Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.455000 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f6693ac-bbca-4ad0-afb2-00bb8227c767-crio-socket\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.455053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f6693ac-bbca-4ad0-afb2-00bb8227c767-data-volume\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.455166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.455082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.455383 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.455235 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:35:47.455383 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.455277 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:47.955266869 +0000 UTC m=+45.260751474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : secret "insights-runtime-extractor-tls" not found Jul 07 16:35:47.455383 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.455322 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f6693ac-bbca-4ad0-afb2-00bb8227c767-data-volume\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.466484 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.466466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql86h\" (UniqueName: \"kubernetes.io/projected/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-api-access-ql86h\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.615084 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.615016 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:47.690222 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.690198 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:47.959870 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.959848 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.959963 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:47.959898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:47.960019 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.959961 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:35:47.960019 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.959990 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:35:47.960080 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.960019 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:48.960004927 +0000 UTC m=+46.265489529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : configmap "kube-rbac-proxy" not found Jul 07 16:35:47.960080 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:47.960034 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:48.960027904 +0000 UTC m=+46.265512504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : secret "insights-runtime-extractor-tls" not found Jul 07 16:35:48.966490 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:48.966454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:48.967045 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:48.966571 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:48.967045 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:48.966613 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:35:48.967045 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:48.966653 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:35:48.967045 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:48.966670 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:50.966656423 +0000 UTC m=+48.272141024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : secret "insights-runtime-extractor-tls" not found Jul 07 16:35:48.967045 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:48.966690 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:50.966680175 +0000 UTC m=+48.272164775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : configmap "kube-rbac-proxy" not found Jul 07 16:35:49.369344 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.369265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:49.369344 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.369308 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:49.369579 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.369415 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:49.369579 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.369425 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:35:49.369579 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.369444 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-698cf5c9bd-4t7jl: secret "image-registry-tls" not found Jul 07 16:35:49.369579 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.369464 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls podName:1fa3e5d2-2429-4d25-9abe-6c7a786f912f nodeName:}" failed. No retries permitted until 2026-07-07 16:35:57.369452325 +0000 UTC m=+54.674936926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vr97h" (UID: "1fa3e5d2-2429-4d25-9abe-6c7a786f912f") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:49.369579 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.369493 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls podName:29907fbb-7dc2-404b-8e61-95c708baf822 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:57.3694778 +0000 UTC m=+54.674962413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls") pod "image-registry-698cf5c9bd-4t7jl" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822") : secret "image-registry-tls" not found Jul 07 16:35:49.426655 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.426631 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vz7rh_2b1e6f79-37c1-4239-89e0-744d9e2a5862/dns-node-resolver/0.log" Jul 07 16:35:49.470065 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.470042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:49.470166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.470094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:49.470212 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.470183 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:57.470167365 +0000 UTC m=+54.775651988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : configmap references non-existent config key: service-ca.crt Jul 07 16:35:49.470277 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.470236 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:35:49.470327 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.470279 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:35:57.47026844 +0000 UTC m=+54.775753048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : secret "router-metrics-certs-default" not found Jul 07 16:35:49.571426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.571402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:49.571507 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.571496 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:35:49.571562 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:49.571552 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls podName:33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa nodeName:}" failed. No retries permitted until 2026-07-07 16:35:57.571541383 +0000 UTC m=+54.877025982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls") pod "dns-default-qwn9n" (UID: "33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa") : secret "dns-default-metrics-tls" not found Jul 07 16:35:49.829283 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:49.829256 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cf2hz_22494f3d-9978-4b22-8ea6-4582900753e4/node-ca/0.log" Jul 07 16:35:50.625714 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:50.625689 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gbpt9_06a66a91-122b-41dd-b912-774a663fbc7f/serve-healthcheck-canary/0.log" Jul 07 16:35:50.682909 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:50.682885 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:50.780602 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:50.780570 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:50.859764 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:50.859739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:50.981749 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:50.981724 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:50.981846 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:50.981818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:50.981883 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:50.981842 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:35:50.981913 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:50.981893 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:54.981879617 +0000 UTC m=+52.287364217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : configmap "kube-rbac-proxy" not found Jul 07 16:35:50.981962 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:50.981947 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:35:50.982028 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:50.982017 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:35:54.981998292 +0000 UTC m=+52.287482895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : secret "insights-runtime-extractor-tls" not found Jul 07 16:35:51.173764 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:51.173733 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:51.269979 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:51.269907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:51.370076 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:51.370052 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:52.611810 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:52.611781 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:52.711544 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:52.711508 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:53.340309 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:53.340274 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:53.440959 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:53.440926 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:54.737978 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:54.737946 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:54.853299 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:54.853260 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:54.988748 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:54.988677 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:55.014264 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:55.014241 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:55.014421 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:55.014377 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:35:55.014421 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:55.014378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:35:55.014538 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:55.014426 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:03.014412523 +0000 UTC m=+60.319897123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : secret "insights-runtime-extractor-tls" not found Jul 07 16:35:55.014538 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:55.014463 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:35:55.014627 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:55.014544 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:03.014513312 +0000 UTC m=+60.319997915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : configmap "kube-rbac-proxy" not found Jul 07 16:35:55.070066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:55.070042 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:55.997992 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:55.997955 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:56.059434 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:56.059404 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:57.322074 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.322042 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:57.435347 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.435325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:35:57.435470 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.435362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:35:57.435513 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.435477 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:35:57.435513 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.435488 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:57.435513 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.435492 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-698cf5c9bd-4t7jl: secret "image-registry-tls" not found Jul 07 16:35:57.435623 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.435557 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls podName:1fa3e5d2-2429-4d25-9abe-6c7a786f912f nodeName:}" failed. No retries permitted until 2026-07-07 16:36:13.435540957 +0000 UTC m=+70.741025575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vr97h" (UID: "1fa3e5d2-2429-4d25-9abe-6c7a786f912f") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:35:57.435623 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.435573 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls podName:29907fbb-7dc2-404b-8e61-95c708baf822 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:13.435567249 +0000 UTC m=+70.741051848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls") pod "image-registry-698cf5c9bd-4t7jl" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822") : secret "image-registry-tls" not found Jul 07 16:35:57.480813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.480788 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:57.536054 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.536033 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:57.536225 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.536077 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:35:57.536225 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.536203 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:36:13.536182434 +0000 UTC m=+70.841667035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : configmap references non-existent config key: service-ca.crt Jul 07 16:35:57.536225 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.536205 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:35:57.536397 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.536247 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs podName:b83d95e4-4811-4a66-9363-4ae10f29a99e nodeName:}" failed. No retries permitted until 2026-07-07 16:36:13.536237108 +0000 UTC m=+70.841721711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs") pod "router-default-5779866cb7-wjhtf" (UID: "b83d95e4-4811-4a66-9363-4ae10f29a99e") : secret "router-metrics-certs-default" not found Jul 07 16:35:57.636790 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.636733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:35:57.636876 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.636860 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:35:57.636915 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:35:57.636908 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls podName:33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa nodeName:}" failed. No retries permitted until 2026-07-07 16:36:13.636896079 +0000 UTC m=+70.942380684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls") pod "dns-default-qwn9n" (UID: "33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa") : secret "dns-default-metrics-tls" not found Jul 07 16:35:57.709725 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.709690 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:57.914805 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:57.914771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:58.013787 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:58.013757 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:58.155347 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:58.155317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:58.254773 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:58.254698 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:58.429343 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:58.429313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:59.227538 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:59.227492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:59.449981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:59.449946 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:59.618289 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:59.618226 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:35:59.823839 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:35:59.823806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:00.222427 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:00.222399 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:00.770321 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:00.770284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:00.844813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:00.844786 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:01.044892 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:01.044820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:01.178558 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:01.178509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:01.290442 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:01.290418 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:01.627327 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:01.627296 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:01.702316 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:01.702288 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:02.038401 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:02.038365 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:02.439442 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:02.439409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:02.832329 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:02.832258 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:02.973486 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:02.973458 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:03.081705 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:03.081682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:36:03.082019 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:03.081731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:36:03.082019 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:36:03.081843 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:36:03.082019 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:36:03.081893 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls podName:5f6693ac-bbca-4ad0-afb2-00bb8227c767 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:19.081880573 +0000 UTC m=+76.387365173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bj7kt" (UID: "5f6693ac-bbca-4ad0-afb2-00bb8227c767") : secret "insights-runtime-extractor-tls" not found Jul 07 16:36:03.082131 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:03.082096 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f6693ac-bbca-4ad0-afb2-00bb8227c767-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:36:03.124365 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:03.124301 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:03.429589 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:03.429557 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:03.561849 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:03.561820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:04.226879 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:04.226844 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:04.694570 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:04.694539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:04.840787 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:04.840766 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:05.048986 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:05.048904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:05.441786 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:05.441756 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:06.025506 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:06.025477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:06.626056 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:06.626014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:06.819713 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:06.819683 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:07.028853 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:07.028822 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:07.215144 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:07.215114 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:07.283256 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:07.283184 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:07.439593 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:07.439572 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7vwl" Jul 07 16:36:07.828610 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:07.828575 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:08.043958 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.043929 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:08.534886 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.534848 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:08.636383 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.636357 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:08.702451 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.702429 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:08.833708 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.833627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:08.924271 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.924248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:36:08.924424 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.924282 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:36:08.927703 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.927684 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:36:08.927809 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.927683 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:36:08.937119 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.937101 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d57cce7-ddc8-47f9-9abb-307d0125974d-original-pull-secret\") pod \"global-pull-secret-syncer-7jqvn\" (UID: \"9d57cce7-ddc8-47f9-9abb-307d0125974d\") " pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:36:08.937203 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:08.937108 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0703ddfb-7bf8-4e55-9f94-5cdb46f21879-metrics-certs\") pod \"network-metrics-daemon-s785t\" (UID: \"0703ddfb-7bf8-4e55-9f94-5cdb46f21879\") " pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:36:09.024678 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.024652 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:36:09.027738 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.027718 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:36:09.037781 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.037761 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:36:09.047389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.047369 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbz67\" (UniqueName: \"kubernetes.io/projected/ee5f53e4-c461-41bb-a77f-739f74bb4d23-kube-api-access-cbz67\") pod \"network-check-target-6gt9j\" (UID: \"ee5f53e4-c461-41bb-a77f-739f74bb4d23\") " pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:36:09.099803 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.099749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9ddt\"" Jul 07 16:36:09.106206 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.106191 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jqvn" Jul 07 16:36:09.107259 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.107245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:36:09.115202 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.115189 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hwxng\"" Jul 07 16:36:09.123090 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.122632 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s785t" Jul 07 16:36:09.211280 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.211244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.254480 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.254444 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jqvn"] Jul 07 16:36:09.257817 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:09.257793 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d57cce7_ddc8_47f9_9abb_307d0125974d.slice/crio-7dcd92fde817f7fe6856c3379e5aa3aba4a87bc5254db3deb69eea61c9b50caa WatchSource:0}: Error finding container 7dcd92fde817f7fe6856c3379e5aa3aba4a87bc5254db3deb69eea61c9b50caa: Status 404 returned error can't find the container with id 7dcd92fde817f7fe6856c3379e5aa3aba4a87bc5254db3deb69eea61c9b50caa Jul 07 16:36:09.311598 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.311563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.414010 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.413984 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.483062 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.483042 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6gt9j"] Jul 07 16:36:09.485070 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:09.485048 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5f53e4_c461_41bb_a77f_739f74bb4d23.slice/crio-a0629402d1e10fb57000e9bc38b487cdce88dd8065f488dd837e0cc6084e5ff4 WatchSource:0}: Error finding container a0629402d1e10fb57000e9bc38b487cdce88dd8065f488dd837e0cc6084e5ff4: Status 404 returned error can't find the container with id a0629402d1e10fb57000e9bc38b487cdce88dd8065f488dd837e0cc6084e5ff4 Jul 07 16:36:09.501538 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.501500 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s785t"] Jul 07 16:36:09.503990 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:09.503973 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0703ddfb_7bf8_4e55_9f94_5cdb46f21879.slice/crio-def36379d4c0c59d84fa2b9d23e40cf36532d46b306733c0ce36148666f0cc6d WatchSource:0}: Error finding container def36379d4c0c59d84fa2b9d23e40cf36532d46b306733c0ce36148666f0cc6d: Status 404 returned error can't find the container with id def36379d4c0c59d84fa2b9d23e40cf36532d46b306733c0ce36148666f0cc6d Jul 07 16:36:09.505849 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.505824 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.516412 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.516392 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6gt9j" event={"ID":"ee5f53e4-c461-41bb-a77f-739f74bb4d23","Type":"ContainerStarted","Data":"a0629402d1e10fb57000e9bc38b487cdce88dd8065f488dd837e0cc6084e5ff4"} Jul 07 16:36:09.517357 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.517341 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s785t" event={"ID":"0703ddfb-7bf8-4e55-9f94-5cdb46f21879","Type":"ContainerStarted","Data":"def36379d4c0c59d84fa2b9d23e40cf36532d46b306733c0ce36148666f0cc6d"} Jul 07 16:36:09.518312 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.518296 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jqvn" event={"ID":"9d57cce7-ddc8-47f9-9abb-307d0125974d","Type":"ContainerStarted","Data":"7dcd92fde817f7fe6856c3379e5aa3aba4a87bc5254db3deb69eea61c9b50caa"} Jul 07 16:36:09.617054 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.617026 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.817762 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.817691 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:09.913993 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:09.913968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:10.041048 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:10.041001 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:10.249948 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:10.249911 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:10.520834 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:10.520699 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:11.024681 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.024647 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:11.132704 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.132670 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:11.347563 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.347507 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:11.449601 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.449568 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:11.526775 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.526737 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s785t" event={"ID":"0703ddfb-7bf8-4e55-9f94-5cdb46f21879","Type":"ContainerStarted","Data":"2077a9b07e6e9bfb09f75ba1de2ec550088866ddc3258005430fe015696f3799"} Jul 07 16:36:11.526977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.526930 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s785t" event={"ID":"0703ddfb-7bf8-4e55-9f94-5cdb46f21879","Type":"ContainerStarted","Data":"fd19bde21b8c01ea0be2666d6a7771f83363059e5e5f6c49b11d42be893d3521"} Jul 07 16:36:11.550448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:11.550351 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s785t" podStartSLOduration=65.859334365 podStartE2EDuration="1m7.550333319s" totalImagesPullingTime="1.690998954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:11.549083047 +0000 UTC m=+68.854567686" watchObservedRunningTime="2026-07-07 16:36:11.550333319 +0000 UTC m=+68.855817943" Jul 07 16:36:13.467946 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.467913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:36:13.468362 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.467976 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:36:13.470305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.470272 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"image-registry-698cf5c9bd-4t7jl\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:36:13.470305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.470282 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fa3e5d2-2429-4d25-9abe-6c7a786f912f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vr97h\" (UID: \"1fa3e5d2-2429-4d25-9abe-6c7a786f912f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:36:13.534211 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.534182 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6gt9j" event={"ID":"ee5f53e4-c461-41bb-a77f-739f74bb4d23","Type":"ContainerStarted","Data":"bacd75af0c00e5269b289d17cdb3464d887fb7108ccf1e1fa8c618d3d156b20c"} Jul 07 16:36:13.534403 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.534383 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:36:13.561221 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.561172 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6gt9j" podStartSLOduration=66.126591751 podStartE2EDuration="1m9.561158186s" totalImagesPullingTime="3.434566435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:13.558935018 +0000 UTC m=+70.864419668" watchObservedRunningTime="2026-07-07 16:36:13.561158186 +0000 UTC m=+70.866642807" Jul 07 16:36:13.568592 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.568564 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:13.568713 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.568620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:13.569279 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.569250 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83d95e4-4811-4a66-9363-4ae10f29a99e-service-ca-bundle\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:13.571122 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.571102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b83d95e4-4811-4a66-9363-4ae10f29a99e-metrics-certs\") pod \"router-default-5779866cb7-wjhtf\" (UID: \"b83d95e4-4811-4a66-9363-4ae10f29a99e\") " pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:13.669322 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.669294 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:36:13.671687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.671666 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa-metrics-tls\") pod \"dns-default-qwn9n\" (UID: \"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa\") " pod="openshift-dns/dns-default-qwn9n" Jul 07 16:36:13.682188 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.682163 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7xrgf\"" Jul 07 16:36:13.688947 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.688929 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:36:13.695061 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.695044 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r68cw\"" Jul 07 16:36:13.702773 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.702754 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" Jul 07 16:36:13.718895 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.718853 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qx445\"" Jul 07 16:36:13.726449 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.726430 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:13.868189 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.868162 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b7v6b\"" Jul 07 16:36:13.875794 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:13.875767 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qwn9n" Jul 07 16:36:15.021481 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.021454 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5779866cb7-wjhtf"] Jul 07 16:36:15.024488 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:15.024466 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83d95e4_4811_4a66_9363_4ae10f29a99e.slice/crio-45995a59675d6414bb67ed76dcbd7b5b8c095ba141fc672c765f4d7a47cf1e74 WatchSource:0}: Error finding container 45995a59675d6414bb67ed76dcbd7b5b8c095ba141fc672c765f4d7a47cf1e74: Status 404 returned error can't find the container with id 45995a59675d6414bb67ed76dcbd7b5b8c095ba141fc672c765f4d7a47cf1e74 Jul 07 16:36:15.033069 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.028731 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qwn9n"] Jul 07 16:36:15.189768 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.189731 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h"] Jul 07 16:36:15.192824 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.192799 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-698cf5c9bd-4t7jl"] Jul 07 16:36:15.193189 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:15.193169 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa3e5d2_2429_4d25_9abe_6c7a786f912f.slice/crio-e3939e34e6cb7102db205ddfedc0927a115c592777ccd2f7deead58768404b0e WatchSource:0}: Error finding container e3939e34e6cb7102db205ddfedc0927a115c592777ccd2f7deead58768404b0e: Status 404 returned error can't find the container with id e3939e34e6cb7102db205ddfedc0927a115c592777ccd2f7deead58768404b0e Jul 07 16:36:15.195486 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:15.195432 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29907fbb_7dc2_404b_8e61_95c708baf822.slice/crio-b6a0a53b32f99a1194c9c06a2f0c79600e1a7acdf0d1e1c8aa2b3775b3424383 WatchSource:0}: Error finding container b6a0a53b32f99a1194c9c06a2f0c79600e1a7acdf0d1e1c8aa2b3775b3424383: Status 404 returned error can't find the container with id b6a0a53b32f99a1194c9c06a2f0c79600e1a7acdf0d1e1c8aa2b3775b3424383 Jul 07 16:36:15.541813 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.541781 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qwn9n" event={"ID":"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa","Type":"ContainerStarted","Data":"e80c815b211faf1ea845ddc58d0c26ee00d485ab1421c7bb5fc53b67cd828c7f"} Jul 07 16:36:15.543763 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.543728 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5779866cb7-wjhtf" event={"ID":"b83d95e4-4811-4a66-9363-4ae10f29a99e","Type":"ContainerStarted","Data":"7f568e573b4ae7b418f8668afec5b952924a460ffd0171721af318948b5bacf4"} Jul 07 16:36:15.543881 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.543785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5779866cb7-wjhtf" event={"ID":"b83d95e4-4811-4a66-9363-4ae10f29a99e","Type":"ContainerStarted","Data":"45995a59675d6414bb67ed76dcbd7b5b8c095ba141fc672c765f4d7a47cf1e74"} Jul 07 16:36:15.545591 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.545557 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jqvn" event={"ID":"9d57cce7-ddc8-47f9-9abb-307d0125974d","Type":"ContainerStarted","Data":"e643da209e0fe147b65dbc6f14d1aa73748d1e3de84983a28174df22c27a3446"} Jul 07 16:36:15.547327 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.547296 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" event={"ID":"29907fbb-7dc2-404b-8e61-95c708baf822","Type":"ContainerStarted","Data":"463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469"} Jul 07 16:36:15.547441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.547343 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" event={"ID":"29907fbb-7dc2-404b-8e61-95c708baf822","Type":"ContainerStarted","Data":"b6a0a53b32f99a1194c9c06a2f0c79600e1a7acdf0d1e1c8aa2b3775b3424383"} Jul 07 16:36:15.547441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.547371 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:36:15.548744 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.548716 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" event={"ID":"1fa3e5d2-2429-4d25-9abe-6c7a786f912f","Type":"ContainerStarted","Data":"e3939e34e6cb7102db205ddfedc0927a115c592777ccd2f7deead58768404b0e"} Jul 07 16:36:15.570494 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.570442 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5779866cb7-wjhtf" podStartSLOduration=41.57042578 podStartE2EDuration="41.57042578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:15.569016112 +0000 UTC m=+72.874500762" watchObservedRunningTime="2026-07-07 16:36:15.57042578 +0000 UTC m=+72.875910408" Jul 07 16:36:15.618451 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.618406 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7jqvn" podStartSLOduration=66.020611251 podStartE2EDuration="1m11.618392931s" totalImagesPullingTime="5.59778168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:15.593907217 +0000 UTC m=+72.899391840" watchObservedRunningTime="2026-07-07 16:36:15.618392931 +0000 UTC m=+72.923877552" Jul 07 16:36:15.618673 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.618640 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" podStartSLOduration=71.618629374 podStartE2EDuration="1m11.618629374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:15.618297648 +0000 UTC m=+72.923782273" watchObservedRunningTime="2026-07-07 16:36:15.618629374 +0000 UTC m=+72.924113996" Jul 07 16:36:15.727280 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.727246 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:15.730018 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:15.729996 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:16.553031 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:16.553002 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:16.554242 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:16.554223 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5779866cb7-wjhtf" Jul 07 16:36:17.557291 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:17.557262 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qwn9n" event={"ID":"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa","Type":"ContainerStarted","Data":"999bbe49e785a94abf915d518b7bb5967541bde97795f083dbfdc8eda783e4cc"} Jul 07 16:36:17.881608 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:17.881515 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:18.100860 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.100828 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:18.193715 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.193680 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:18.430855 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.430824 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:18.562585 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.562494 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qwn9n" event={"ID":"33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa","Type":"ContainerStarted","Data":"a2f241f4b4cfc6186539a3cf6a5d1ebad93f5f15e1554952c458901d46231da0"} Jul 07 16:36:18.562978 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.562591 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qwn9n" Jul 07 16:36:18.564020 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.563991 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" event={"ID":"1fa3e5d2-2429-4d25-9abe-6c7a786f912f","Type":"ContainerStarted","Data":"1cef08de3ce518586a07250cff9e2c6bc1562311f5a0c5e649c9fcd5e6ad397f"} Jul 07 16:36:18.643873 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.643824 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qwn9n" podStartSLOduration=35.761929687 podStartE2EDuration="37.643809919s" totalImagesPullingTime="1.881880232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:18.639713311 +0000 UTC m=+75.945197945" watchObservedRunningTime="2026-07-07 16:36:18.643809919 +0000 UTC m=+75.949294541" Jul 07 16:36:18.755391 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.755347 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vr97h" podStartSLOduration=42.398825652 podStartE2EDuration="44.755330055s" totalImagesPullingTime="2.356504403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:18.69707612 +0000 UTC m=+76.002560741" watchObservedRunningTime="2026-07-07 16:36:18.755330055 +0000 UTC m=+76.060814681" Jul 07 16:36:18.755664 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.755647 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q"] Jul 07 16:36:18.758065 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.758046 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:18.762191 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.762173 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 16:36:18.762275 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.762177 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h4ccc\"" Jul 07 16:36:18.771269 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.771250 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 16:36:18.805648 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.805629 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q"] Jul 07 16:36:18.837394 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.837345 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5zjnp"] Jul 07 16:36:18.839481 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.839467 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj"] Jul 07 16:36:18.839614 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.839599 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:18.841698 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.841679 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf7cf547b-frvzl"] Jul 07 16:36:18.841839 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.841820 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:18.843677 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.843660 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:18.848406 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848387 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:36:18.848406 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848389 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:36:18.848654 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848417 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:36:18.848654 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848486 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:36:18.848654 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848584 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fchdd\"" Jul 07 16:36:18.848799 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848757 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gffjk\"" Jul 07 16:36:18.849060 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848939 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:36:18.849060 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.848969 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:36:18.851172 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.851153 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2l8gk\"" Jul 07 16:36:18.851609 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.851589 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 16:36:18.853485 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.853465 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:36:18.866971 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.866952 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5zjnp"] Jul 07 16:36:18.868206 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.868192 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj"] Jul 07 16:36:18.869268 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.869247 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf7cf547b-frvzl"] Jul 07 16:36:18.914821 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.914792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c75f1b45-79db-4c42-966f-bc789956dde2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wqx9q\" (UID: \"c75f1b45-79db-4c42-966f-bc789956dde2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:18.914946 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.914885 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c75f1b45-79db-4c42-966f-bc789956dde2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wqx9q\" (UID: \"c75f1b45-79db-4c42-966f-bc789956dde2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:18.945302 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:18.945279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:19.015766 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-oauth-serving-cert\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.015859 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c28c4\" (UniqueName: \"kubernetes.io/projected/62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0-kube-api-access-c28c4\") pod \"downloads-685bfb5f64-5zjnp\" (UID: \"62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0\") " pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:19.015859 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015790 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-service-ca\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.015859 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-serving-cert\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.015859 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c75f1b45-79db-4c42-966f-bc789956dde2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wqx9q\" (UID: \"c75f1b45-79db-4c42-966f-bc789956dde2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:19.015985 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015878 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-oauth-config\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.015985 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015917 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c75f1b45-79db-4c42-966f-bc789956dde2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wqx9q\" (UID: \"c75f1b45-79db-4c42-966f-bc789956dde2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:19.015985 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-console-config\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.015985 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.015958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvpp5\" (UniqueName: \"kubernetes.io/projected/1c18a2fe-decc-439e-831d-c794b4a583ca-kube-api-access-fvpp5\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.016104 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.016041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b47d1c24-65a7-475c-95cd-b556bdb9d19d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8rzdj\" (UID: \"b47d1c24-65a7-475c-95cd-b556bdb9d19d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:19.016567 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.016546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c75f1b45-79db-4c42-966f-bc789956dde2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wqx9q\" (UID: \"c75f1b45-79db-4c42-966f-bc789956dde2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:19.018112 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.018094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c75f1b45-79db-4c42-966f-bc789956dde2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wqx9q\" (UID: \"c75f1b45-79db-4c42-966f-bc789956dde2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:19.044204 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.044182 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:19.067274 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.067256 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" Jul 07 16:36:19.116478 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:36:19.116614 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116508 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b47d1c24-65a7-475c-95cd-b556bdb9d19d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8rzdj\" (UID: \"b47d1c24-65a7-475c-95cd-b556bdb9d19d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:19.116614 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116565 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-oauth-serving-cert\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.116614 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116601 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28c4\" (UniqueName: \"kubernetes.io/projected/62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0-kube-api-access-c28c4\") pod \"downloads-685bfb5f64-5zjnp\" (UID: \"62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0\") " pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:19.116780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-service-ca\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.116780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-serving-cert\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.116780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116713 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-oauth-config\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.116780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-console-config\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.116977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.116798 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvpp5\" (UniqueName: \"kubernetes.io/projected/1c18a2fe-decc-439e-831d-c794b4a583ca-kube-api-access-fvpp5\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.118173 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.117641 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-oauth-serving-cert\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.118173 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.117828 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-console-config\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.118173 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.117964 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-service-ca\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.119212 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.119185 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f6693ac-bbca-4ad0-afb2-00bb8227c767-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bj7kt\" (UID: \"5f6693ac-bbca-4ad0-afb2-00bb8227c767\") " pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:36:19.120132 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.120111 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-oauth-config\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.120566 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.120395 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-serving-cert\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.120998 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.120971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b47d1c24-65a7-475c-95cd-b556bdb9d19d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8rzdj\" (UID: \"b47d1c24-65a7-475c-95cd-b556bdb9d19d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:19.129907 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.129756 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c28c4\" (UniqueName: \"kubernetes.io/projected/62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0-kube-api-access-c28c4\") pod \"downloads-685bfb5f64-5zjnp\" (UID: \"62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0\") " pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:19.132296 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.132269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvpp5\" (UniqueName: \"kubernetes.io/projected/1c18a2fe-decc-439e-831d-c794b4a583ca-kube-api-access-fvpp5\") pod \"console-7bf7cf547b-frvzl\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.149822 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.149780 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:19.155916 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.155894 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:19.160136 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.160112 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:19.197387 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.197349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:19.215204 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.214854 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q"] Jul 07 16:36:19.223148 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:19.219856 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75f1b45_79db_4c42_966f_bc789956dde2.slice/crio-5fbce484098c93f61405f1855b3a3c5b66f3b0995d741d18abda93c6bfc2e6a9 WatchSource:0}: Error finding container 5fbce484098c93f61405f1855b3a3c5b66f3b0995d741d18abda93c6bfc2e6a9: Status 404 returned error can't find the container with id 5fbce484098c93f61405f1855b3a3c5b66f3b0995d741d18abda93c6bfc2e6a9 Jul 07 16:36:19.310366 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.310334 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:19.326591 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.326571 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5zjnp"] Jul 07 16:36:19.328301 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:19.328275 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f9d2a1_8ebc_4fde_8ecb_45fbe4a6d2b0.slice/crio-53033723912be988eaf9359621dc20cf07144e571171a23296a700c54a321553 WatchSource:0}: Error finding container 53033723912be988eaf9359621dc20cf07144e571171a23296a700c54a321553: Status 404 returned error can't find the container with id 53033723912be988eaf9359621dc20cf07144e571171a23296a700c54a321553 Jul 07 16:36:19.363636 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.363588 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jzqmj\"" Jul 07 16:36:19.370261 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:19.370235 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c18a2fe_decc_439e_831d_c794b4a583ca.slice/crio-d9c710950cb77a56010f2d33e281ae287ee02f1fd4d856e011b8fd1de3857a87 WatchSource:0}: Error finding container d9c710950cb77a56010f2d33e281ae287ee02f1fd4d856e011b8fd1de3857a87: Status 404 returned error can't find the container with id d9c710950cb77a56010f2d33e281ae287ee02f1fd4d856e011b8fd1de3857a87 Jul 07 16:36:19.370733 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.370714 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj"] Jul 07 16:36:19.370793 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.370740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bj7kt" Jul 07 16:36:19.371121 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:19.371100 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47d1c24_65a7_475c_95cd_b556bdb9d19d.slice/crio-a97ca36f83a0b0577b90c6645473b407633f3dc01d71b277fd0e1b37e7f4e306 WatchSource:0}: Error finding container a97ca36f83a0b0577b90c6645473b407633f3dc01d71b277fd0e1b37e7f4e306: Status 404 returned error can't find the container with id a97ca36f83a0b0577b90c6645473b407633f3dc01d71b277fd0e1b37e7f4e306 Jul 07 16:36:19.372196 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.372178 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf7cf547b-frvzl"] Jul 07 16:36:19.503967 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.503940 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bj7kt"] Jul 07 16:36:19.507408 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:19.507383 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6693ac_bbca_4ad0_afb2_00bb8227c767.slice/crio-d9d19ebec415614a196a79488a8e1bfb81f7c63fccbfd2f571cb6f5f3cc9f2f8 WatchSource:0}: Error finding container d9d19ebec415614a196a79488a8e1bfb81f7c63fccbfd2f571cb6f5f3cc9f2f8: Status 404 returned error can't find the container with id d9d19ebec415614a196a79488a8e1bfb81f7c63fccbfd2f571cb6f5f3cc9f2f8 Jul 07 16:36:19.567812 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.567784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" event={"ID":"b47d1c24-65a7-475c-95cd-b556bdb9d19d","Type":"ContainerStarted","Data":"a97ca36f83a0b0577b90c6645473b407633f3dc01d71b277fd0e1b37e7f4e306"} Jul 07 16:36:19.568872 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.568851 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bj7kt" event={"ID":"5f6693ac-bbca-4ad0-afb2-00bb8227c767","Type":"ContainerStarted","Data":"d9d19ebec415614a196a79488a8e1bfb81f7c63fccbfd2f571cb6f5f3cc9f2f8"} Jul 07 16:36:19.569843 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.569823 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7cf547b-frvzl" event={"ID":"1c18a2fe-decc-439e-831d-c794b4a583ca","Type":"ContainerStarted","Data":"d9c710950cb77a56010f2d33e281ae287ee02f1fd4d856e011b8fd1de3857a87"} Jul 07 16:36:19.570820 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.570800 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5zjnp" event={"ID":"62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0","Type":"ContainerStarted","Data":"53033723912be988eaf9359621dc20cf07144e571171a23296a700c54a321553"} Jul 07 16:36:19.571779 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:19.571754 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" event={"ID":"c75f1b45-79db-4c42-966f-bc789956dde2","Type":"ContainerStarted","Data":"5fbce484098c93f61405f1855b3a3c5b66f3b0995d741d18abda93c6bfc2e6a9"} Jul 07 16:36:22.591876 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.591837 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" event={"ID":"c75f1b45-79db-4c42-966f-bc789956dde2","Type":"ContainerStarted","Data":"7d3380ef68cec6ef0b157f85183829ea5bebec7c731bfe4f030396134d412323"} Jul 07 16:36:22.593535 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.593489 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" event={"ID":"b47d1c24-65a7-475c-95cd-b556bdb9d19d","Type":"ContainerStarted","Data":"a2c455da602b44e3f7da4e206f417f05eac2172701f1e6328bc00af3dad2ee3f"} Jul 07 16:36:22.593663 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.593559 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:22.599024 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.599005 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" Jul 07 16:36:22.614196 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.614156 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wqx9q" podStartSLOduration=2.240444923 podStartE2EDuration="4.614143151s" totalImagesPullingTime="2.373698228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:22.613627249 +0000 UTC m=+79.919111872" watchObservedRunningTime="2026-07-07 16:36:22.614143151 +0000 UTC m=+79.919627772" Jul 07 16:36:22.637009 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.636970 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8rzdj" podStartSLOduration=2.412125232 podStartE2EDuration="4.636956865s" totalImagesPullingTime="2.224831633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:22.636290086 +0000 UTC m=+79.941774709" watchObservedRunningTime="2026-07-07 16:36:22.636956865 +0000 UTC m=+79.942441466" Jul 07 16:36:22.740178 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.740145 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:22.839153 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.839117 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:22.906006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:22.905827 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:23.183994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.183962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:23.237959 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.237928 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng"] Jul 07 16:36:23.241457 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.241435 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.246390 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.246365 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 16:36:23.246505 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.246403 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:36:23.246615 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.246586 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pp4r5\"" Jul 07 16:36:23.246763 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.246646 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 16:36:23.254373 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.254351 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng"] Jul 07 16:36:23.282057 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.281888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:23.351858 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.351829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.352005 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.351862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.352005 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.351950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59qq\" (UniqueName: \"kubernetes.io/projected/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-kube-api-access-t59qq\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.352005 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.351985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.453182 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.453104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59qq\" (UniqueName: \"kubernetes.io/projected/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-kube-api-access-t59qq\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.453182 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.453144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.453367 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.453247 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.453367 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.453272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.454290 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:36:23.453796 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 16:36:23.454290 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:36:23.453869 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-tls podName:c22e0e90-fa1a-4f37-8987-ca92d42fa5c5 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:23.953848942 +0000 UTC m=+81.259333558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-rd4ng" (UID: "c22e0e90-fa1a-4f37-8987-ca92d42fa5c5") : secret "prometheus-operator-tls" not found Jul 07 16:36:23.454424 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.454399 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.456832 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.456802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.467122 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.467096 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59qq\" (UniqueName: \"kubernetes.io/projected/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-kube-api-access-t59qq\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.519816 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.519786 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:23.958306 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.958268 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:23.961063 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:23.961013 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c22e0e90-fa1a-4f37-8987-ca92d42fa5c5-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rd4ng\" (UID: \"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:24.153066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:24.153029 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" Jul 07 16:36:25.113615 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.113481 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69b644444d-42sgh"] Jul 07 16:36:25.116810 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.116789 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.127434 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.127414 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:36:25.148336 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.148313 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b644444d-42sgh"] Jul 07 16:36:25.269118 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269082 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-trusted-ca-bundle\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.269281 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-service-ca\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.269281 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-config\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.269405 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-serving-cert\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.269405 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269328 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-oauth-serving-cert\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.269491 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269422 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djw24\" (UniqueName: \"kubernetes.io/projected/7c2a0711-d048-4ea8-9e77-1f0e21765158-kube-api-access-djw24\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.269491 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.269468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-oauth-config\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.370758 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-config\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.370758 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370725 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-serving-cert\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.370758 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370748 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-oauth-serving-cert\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371014 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370783 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djw24\" (UniqueName: \"kubernetes.io/projected/7c2a0711-d048-4ea8-9e77-1f0e21765158-kube-api-access-djw24\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371014 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370807 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-oauth-config\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371014 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-trusted-ca-bundle\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371014 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.370878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-service-ca\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371635 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.371610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-config\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371635 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.371621 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-oauth-serving-cert\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371808 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.371641 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-service-ca\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.371866 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.371844 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-trusted-ca-bundle\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.373713 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.373685 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-oauth-config\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.373846 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.373813 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-serving-cert\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.381278 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.381252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djw24\" (UniqueName: \"kubernetes.io/projected/7c2a0711-d048-4ea8-9e77-1f0e21765158-kube-api-access-djw24\") pod \"console-69b644444d-42sgh\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.427369 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.427348 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:25.543991 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.543059 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng"] Jul 07 16:36:25.548822 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:25.548287 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22e0e90_fa1a_4f37_8987_ca92d42fa5c5.slice/crio-5688ca006ac3d7c2cad2133db474b575d4d40da6a9f0fb461f4c1f0e58489d46 WatchSource:0}: Error finding container 5688ca006ac3d7c2cad2133db474b575d4d40da6a9f0fb461f4c1f0e58489d46: Status 404 returned error can't find the container with id 5688ca006ac3d7c2cad2133db474b575d4d40da6a9f0fb461f4c1f0e58489d46 Jul 07 16:36:25.604948 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.604919 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b644444d-42sgh"] Jul 07 16:36:25.609209 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.609181 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bj7kt" event={"ID":"5f6693ac-bbca-4ad0-afb2-00bb8227c767","Type":"ContainerStarted","Data":"376250ef9219df99ac84f8d7d8977fda640440de09930587df2a37a85a468cdd"} Jul 07 16:36:25.609469 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:25.609442 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2a0711_d048_4ea8_9e77_1f0e21765158.slice/crio-e35f135c5e2d957c1d081ee8b5aee350bf9662ef2b361ec019c7e91eeae4c7c2 WatchSource:0}: Error finding container e35f135c5e2d957c1d081ee8b5aee350bf9662ef2b361ec019c7e91eeae4c7c2: Status 404 returned error can't find the container with id e35f135c5e2d957c1d081ee8b5aee350bf9662ef2b361ec019c7e91eeae4c7c2 Jul 07 16:36:25.611073 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.611026 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7cf547b-frvzl" event={"ID":"1c18a2fe-decc-439e-831d-c794b4a583ca","Type":"ContainerStarted","Data":"432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c"} Jul 07 16:36:25.612508 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.612484 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" event={"ID":"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5","Type":"ContainerStarted","Data":"5688ca006ac3d7c2cad2133db474b575d4d40da6a9f0fb461f4c1f0e58489d46"} Jul 07 16:36:25.632335 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.632286 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf7cf547b-frvzl" podStartSLOduration=1.597850843 podStartE2EDuration="7.632267705s" totalImagesPullingTime="6.034416862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:25.631465633 +0000 UTC m=+82.936950284" watchObservedRunningTime="2026-07-07 16:36:25.632267705 +0000 UTC m=+82.937752307" Jul 07 16:36:25.885288 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:25.885205 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:26.037070 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:26.037019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:26.137167 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:26.137097 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:26.618707 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:26.618668 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bj7kt" event={"ID":"5f6693ac-bbca-4ad0-afb2-00bb8227c767","Type":"ContainerStarted","Data":"9a079acfb87d4f31fd75fe0b3ed517a99808bb4835a451ca4c46fff27daeea21"} Jul 07 16:36:26.621839 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:26.621341 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b644444d-42sgh" event={"ID":"7c2a0711-d048-4ea8-9e77-1f0e21765158","Type":"ContainerStarted","Data":"44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881"} Jul 07 16:36:26.621839 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:26.621391 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b644444d-42sgh" event={"ID":"7c2a0711-d048-4ea8-9e77-1f0e21765158","Type":"ContainerStarted","Data":"e35f135c5e2d957c1d081ee8b5aee350bf9662ef2b361ec019c7e91eeae4c7c2"} Jul 07 16:36:26.653498 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:26.653445 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69b644444d-42sgh" podStartSLOduration=1.653427309 podStartE2EDuration="1.653427309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:26.651041623 +0000 UTC m=+83.956526293" watchObservedRunningTime="2026-07-07 16:36:26.653427309 +0000 UTC m=+83.958911928" Jul 07 16:36:27.628743 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:27.628655 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" event={"ID":"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5","Type":"ContainerStarted","Data":"8b1dc97518cf55bae73b32acebcf9ede8e4bb20d28cdd6f05fd86b4b487a6b93"} Jul 07 16:36:27.628743 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:27.628714 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" event={"ID":"c22e0e90-fa1a-4f37-8987-ca92d42fa5c5","Type":"ContainerStarted","Data":"e236899534b501e9451a10cc0b6d083005033e9a188d102bdd5d7868af78e301"} Jul 07 16:36:27.663711 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:27.663651 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rd4ng" podStartSLOduration=2.849898357 podStartE2EDuration="4.663630442s" totalImagesPullingTime="1.813732085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:27.663477653 +0000 UTC m=+84.968962314" watchObservedRunningTime="2026-07-07 16:36:27.663630442 +0000 UTC m=+84.969115065" Jul 07 16:36:27.765325 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:27.765292 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:28.574367 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:28.574334 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qwn9n" Jul 07 16:36:29.160333 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.160287 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:29.160752 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.160388 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:36:29.161947 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.161916 2555 patch_prober.go:28] interesting pod/console-7bf7cf547b-frvzl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 07 16:36:29.162046 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.161960 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bf7cf547b-frvzl" podUID="1c18a2fe-decc-439e-831d-c794b4a583ca" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 07 16:36:29.390071 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.389974 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:29.599121 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.599085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:29.639059 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.639028 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bj7kt" event={"ID":"5f6693ac-bbca-4ad0-afb2-00bb8227c767","Type":"ContainerStarted","Data":"ba60702203d1ba9b433c9e4e2f30f109782f274767bb333bb82a031c2a3bea8d"} Jul 07 16:36:29.671377 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.671349 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh"] Jul 07 16:36:29.674893 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.674874 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.681086 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.681047 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 16:36:29.681086 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.681070 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 16:36:29.681925 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.681902 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 16:36:29.682052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.681947 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qhls8\"" Jul 07 16:36:29.697448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.697406 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bj7kt" podStartSLOduration=33.284250791 podStartE2EDuration="42.697394307s" totalImagesPullingTime="9.413143516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:35:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:29.682392648 +0000 UTC m=+86.987877295" watchObservedRunningTime="2026-07-07 16:36:29.697394307 +0000 UTC m=+87.002878929" Jul 07 16:36:29.697752 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.697728 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh"] Jul 07 16:36:29.700376 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.700353 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5k2q9"] Jul 07 16:36:29.704036 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.704014 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.709356 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.709336 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wcshj\"" Jul 07 16:36:29.709807 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.709785 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:36:29.710055 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.710031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:36:29.715236 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.715218 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:36:29.737394 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.737364 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:29.806961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.806933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-wtmp\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807078 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.806981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbwb\" (UniqueName: \"kubernetes.io/projected/fb3df532-7276-424d-9dd4-5b5484102822-kube-api-access-tmbwb\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.807078 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-root\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807078 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807240 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807240 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807113 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wshc9\" (UniqueName: \"kubernetes.io/projected/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-kube-api-access-wshc9\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807240 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fb3df532-7276-424d-9dd4-5b5484102822-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.807240 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-sys\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807240 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb3df532-7276-424d-9dd4-5b5484102822-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.807426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807245 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.807426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-textfile\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807305 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-metrics-client-ca\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-tls\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.807426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.807426 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.807408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.834205 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.834179 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:29.908339 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-textfile\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908445 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908345 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-metrics-client-ca\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908445 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-tls\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908445 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.908639 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908452 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.908639 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-wtmp\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908639 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908507 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbwb\" (UniqueName: \"kubernetes.io/projected/fb3df532-7276-424d-9dd4-5b5484102822-kube-api-access-tmbwb\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.908639 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908592 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-root\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908681 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-wtmp\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908730 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-textfile\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wshc9\" (UniqueName: \"kubernetes.io/projected/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-kube-api-access-wshc9\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fb3df532-7276-424d-9dd4-5b5484102822-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908793 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-root\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.908828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-sys\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.909202 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb3df532-7276-424d-9dd4-5b5484102822-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.909202 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.908875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.909293 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.909226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fb3df532-7276-424d-9dd4-5b5484102822-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.909396 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.909372 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-metrics-client-ca\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.909455 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.909441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-sys\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.909510 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.909377 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.909881 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.909857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.910006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.909983 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb3df532-7276-424d-9dd4-5b5484102822-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.911053 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.911032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.911170 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.911072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-node-exporter-tls\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.911170 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.911162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.911254 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.911173 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb3df532-7276-424d-9dd4-5b5484102822-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.919480 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.919456 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wshc9\" (UniqueName: \"kubernetes.io/projected/fd68252f-8aa6-49e3-8f7b-e2170ae448ed-kube-api-access-wshc9\") pod \"node-exporter-5k2q9\" (UID: \"fd68252f-8aa6-49e3-8f7b-e2170ae448ed\") " pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:29.919739 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.919724 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbwb\" (UniqueName: \"kubernetes.io/projected/fb3df532-7276-424d-9dd4-5b5484102822-kube-api-access-tmbwb\") pod \"kube-state-metrics-7c9dbb8b7d-dt8kh\" (UID: \"fb3df532-7276-424d-9dd4-5b5484102822\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:29.986740 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:29.986647 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" Jul 07 16:36:30.010107 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.010074 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:30.013936 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.013913 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5k2q9" Jul 07 16:36:30.025483 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:30.025457 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd68252f_8aa6_49e3_8f7b_e2170ae448ed.slice/crio-d32c68fe169ce32502c27e29655ec2039368dde8644c47d2818e8503108febcd WatchSource:0}: Error finding container d32c68fe169ce32502c27e29655ec2039368dde8644c47d2818e8503108febcd: Status 404 returned error can't find the container with id d32c68fe169ce32502c27e29655ec2039368dde8644c47d2818e8503108febcd Jul 07 16:36:30.111271 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.111225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:30.138335 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.138309 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh"] Jul 07 16:36:30.140761 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:30.140737 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3df532_7276_424d_9dd4_5b5484102822.slice/crio-ed66cf2721ba305ef0e92a64f3318f09d3f04b494a03267c4bfc97bcb1ac62b1 WatchSource:0}: Error finding container ed66cf2721ba305ef0e92a64f3318f09d3f04b494a03267c4bfc97bcb1ac62b1: Status 404 returned error can't find the container with id ed66cf2721ba305ef0e92a64f3318f09d3f04b494a03267c4bfc97bcb1ac62b1 Jul 07 16:36:30.301701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.301627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:30.634070 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.633983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:30.644464 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.644434 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" event={"ID":"fb3df532-7276-424d-9dd4-5b5484102822","Type":"ContainerStarted","Data":"ed66cf2721ba305ef0e92a64f3318f09d3f04b494a03267c4bfc97bcb1ac62b1"} Jul 07 16:36:30.645821 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.645789 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k2q9" event={"ID":"fd68252f-8aa6-49e3-8f7b-e2170ae448ed","Type":"ContainerStarted","Data":"d32c68fe169ce32502c27e29655ec2039368dde8644c47d2818e8503108febcd"} Jul 07 16:36:30.765640 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:30.765599 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:31.487313 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.487260 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:31.597062 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.596988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:31.652226 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.652194 2555 generic.go:356] "Generic (PLEG): container finished" podID="fd68252f-8aa6-49e3-8f7b-e2170ae448ed" containerID="4a1b2434262765b277001110a733a39aa1adf9e0d350738541b703d7b3ac0f77" exitCode=0 Jul 07 16:36:31.652392 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.652265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k2q9" event={"ID":"fd68252f-8aa6-49e3-8f7b-e2170ae448ed","Type":"ContainerDied","Data":"4a1b2434262765b277001110a733a39aa1adf9e0d350738541b703d7b3ac0f77"} Jul 07 16:36:31.747351 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.747319 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:31.782776 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.782747 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c8cf75f58-5hnz8"] Jul 07 16:36:31.787936 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.787915 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.792843 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.792822 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 16:36:31.792976 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.792875 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 16:36:31.793031 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.792979 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 16:36:31.793282 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.793189 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-88db4\"" Jul 07 16:36:31.793282 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.793261 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 16:36:31.793497 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.793261 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 16:36:31.793590 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.793572 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6jmgbq8n2od41\"" Jul 07 16:36:31.808955 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.808931 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8cf75f58-5hnz8"] Jul 07 16:36:31.828517 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d5eee0b-4e51-47a4-b854-f797ff54c488-metrics-client-ca\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828646 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828560 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828646 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-grpc-tls\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828646 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-tls\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkwz\" (UniqueName: \"kubernetes.io/projected/1d5eee0b-4e51-47a4-b854-f797ff54c488-kube-api-access-2dkwz\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.828795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.828787 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929192 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d5eee0b-4e51-47a4-b854-f797ff54c488-metrics-client-ca\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929344 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929213 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929344 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929246 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-grpc-tls\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929428 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929398 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929480 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929451 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-tls\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929480 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929475 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929591 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929512 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkwz\" (UniqueName: \"kubernetes.io/projected/1d5eee0b-4e51-47a4-b854-f797ff54c488-kube-api-access-2dkwz\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.929635 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.929594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.930094 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.930048 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d5eee0b-4e51-47a4-b854-f797ff54c488-metrics-client-ca\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.932942 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.932881 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-grpc-tls\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.932942 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.932881 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.932942 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.932921 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.933213 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.933182 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.933979 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.933952 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-tls\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.934152 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.934133 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d5eee0b-4e51-47a4-b854-f797ff54c488-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:31.942224 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:31.942202 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkwz\" (UniqueName: \"kubernetes.io/projected/1d5eee0b-4e51-47a4-b854-f797ff54c488-kube-api-access-2dkwz\") pod \"thanos-querier-c8cf75f58-5hnz8\" (UID: \"1d5eee0b-4e51-47a4-b854-f797ff54c488\") " pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:32.100332 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.100264 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:32.658494 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.658460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" event={"ID":"fb3df532-7276-424d-9dd4-5b5484102822","Type":"ContainerStarted","Data":"0ffd2ceed371ecb3093de97fce85658069b709a7d8c31747696db693bcfe5775"} Jul 07 16:36:32.660781 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.660758 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k2q9" event={"ID":"fd68252f-8aa6-49e3-8f7b-e2170ae448ed","Type":"ContainerStarted","Data":"79b58160b853504a632923f851758122bfed4fe7d748713876d17bc54018d80b"} Jul 07 16:36:32.660905 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.660808 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k2q9" event={"ID":"fd68252f-8aa6-49e3-8f7b-e2170ae448ed","Type":"ContainerStarted","Data":"71d0896d1acf5688c7db32c7d128dc1609d8a505848020d80c0fbf8ee7e81c28"} Jul 07 16:36:32.690701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.690645 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5k2q9" podStartSLOduration=2.310790427 podStartE2EDuration="3.690628199s" totalImagesPullingTime="1.310728743s" totalInitContainerRuntime="69.109029ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:32.68904228 +0000 UTC m=+89.994526912" watchObservedRunningTime="2026-07-07 16:36:32.690628199 +0000 UTC m=+89.996112822" Jul 07 16:36:32.857890 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.857854 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:32.947129 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:32.947085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:33.072536 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:33.072469 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:33.175584 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:33.175555 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:33.694326 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:33.694291 2555 patch_prober.go:28] interesting pod/image-registry-698cf5c9bd-4t7jl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 16:36:33.694795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:33.694345 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" podUID="29907fbb-7dc2-404b-8e61-95c708baf822" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 16:36:34.435048 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.435005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:34.492834 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.492802 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd"] Jul 07 16:36:34.497423 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.497401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:34.500734 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.500708 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 16:36:34.500856 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.500769 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rkp9t\"" Jul 07 16:36:34.548606 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.548573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnvj\" (UniqueName: \"kubernetes.io/projected/054e738a-53ff-435a-9ac1-18edfecc9e92-kube-api-access-9gnvj\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:34.548733 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.548648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/054e738a-53ff-435a-9ac1-18edfecc9e92-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:34.563128 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.563102 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:34.570317 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.570289 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd"] Jul 07 16:36:34.649500 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.649474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnvj\" (UniqueName: \"kubernetes.io/projected/054e738a-53ff-435a-9ac1-18edfecc9e92-kube-api-access-9gnvj\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:34.649655 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.649541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/054e738a-53ff-435a-9ac1-18edfecc9e92-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:34.649714 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:36:34.649682 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 07 16:36:34.649757 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:36:34.649735 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054e738a-53ff-435a-9ac1-18edfecc9e92-monitoring-plugin-cert podName:054e738a-53ff-435a-9ac1-18edfecc9e92 nodeName:}" failed. No retries permitted until 2026-07-07 16:36:35.149719633 +0000 UTC m=+92.455204251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/054e738a-53ff-435a-9ac1-18edfecc9e92-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-bfhsd" (UID: "054e738a-53ff-435a-9ac1-18edfecc9e92") : secret "monitoring-plugin-cert" not found Jul 07 16:36:34.661701 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:34.661669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnvj\" (UniqueName: \"kubernetes.io/projected/054e738a-53ff-435a-9ac1-18edfecc9e92-kube-api-access-9gnvj\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:35.067092 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.067057 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:35.154982 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.154861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/054e738a-53ff-435a-9ac1-18edfecc9e92-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:35.158003 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.157973 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/054e738a-53ff-435a-9ac1-18edfecc9e92-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bfhsd\" (UID: \"054e738a-53ff-435a-9ac1-18edfecc9e92\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:35.288839 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.288806 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf7cf547b-frvzl"] Jul 07 16:36:35.408360 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.408282 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:35.428264 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.428234 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:35.428538 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.428498 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:35.434805 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.434785 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:35.679313 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:35.679283 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:36:36.259066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.259026 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:36:36.292687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.290839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:36.296351 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.296330 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.300416 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.300171 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:36:36.304807 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.304604 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 16:36:36.304807 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.304632 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 16:36:36.304807 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.304649 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 16:36:36.304807 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.304745 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 16:36:36.306552 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.305884 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 16:36:36.306552 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.306095 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ffnnr4ho5poek\"" Jul 07 16:36:36.306552 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.306105 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 16:36:36.306552 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.306414 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z5gl4\"" Jul 07 16:36:36.306816 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.306582 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 16:36:36.306816 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.306806 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 16:36:36.307292 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.307131 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 16:36:36.307292 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.307161 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 16:36:36.307292 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.307188 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 16:36:36.316434 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.308643 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 16:36:36.316434 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.308911 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 16:36:36.318832 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.318813 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 16:36:36.319445 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.319419 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 16:36:36.367271 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367396 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367396 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367396 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367557 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367557 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367472 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367557 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367499 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367569 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367592 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4s4\" (UniqueName: \"kubernetes.io/projected/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-kube-api-access-wt4s4\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367722 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367761 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-config\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.367961 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.367895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468614 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468569 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468614 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4s4\" (UniqueName: \"kubernetes.io/projected/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-kube-api-access-wt4s4\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468697 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468714 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-config\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.468841 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468827 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.468973 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.469004 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.469031 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.469058 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.469067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.469290 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.469101 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.470736 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.470408 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.472055 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.472024 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.472251 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.472230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.472393 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.472370 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.473374 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.472714 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.473374 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.473070 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.473374 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.473140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.473374 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.473287 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.473918 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.473895 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.477066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.476621 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.477066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.476650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.477066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.476953 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.477278 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.477130 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.477858 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.477814 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.478096 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.478075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.478212 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.478127 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.478312 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.478143 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-config\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.478403 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.478198 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.479968 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.479923 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.486706 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.486667 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4s4\" (UniqueName: \"kubernetes.io/projected/6f2c6816-d6a1-4ccd-88ba-5d2f497b9405-kube-api-access-wt4s4\") pod \"prometheus-k8s-0\" (UID: \"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.537708 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.537626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:36.558239 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.558217 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:36:36.615755 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.615728 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:36.638421 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.638391 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:36.770305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.770267 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:36.944055 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:36.944017 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:37.790516 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:37.790470 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:37.891773 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:37.891682 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:39.172194 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:39.172157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:39.274233 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:39.274195 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:39.773779 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:39.773754 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8cf75f58-5hnz8"] Jul 07 16:36:39.806125 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:39.806095 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5eee0b_4e51_47a4_b854_f797ff54c488.slice/crio-e1445ff23dcfc4134b5fcf926b69e7e5483a331c618a0815aab752359e678a07 WatchSource:0}: Error finding container e1445ff23dcfc4134b5fcf926b69e7e5483a331c618a0815aab752359e678a07: Status 404 returned error can't find the container with id e1445ff23dcfc4134b5fcf926b69e7e5483a331c618a0815aab752359e678a07 Jul 07 16:36:39.994808 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:39.994778 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd"] Jul 07 16:36:39.997177 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:39.997155 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054e738a_53ff_435a_9ac1_18edfecc9e92.slice/crio-92b7fdc9475555fb96125a9170aa5cf62487ce3210d22cb67bb88c7bce4312db WatchSource:0}: Error finding container 92b7fdc9475555fb96125a9170aa5cf62487ce3210d22cb67bb88c7bce4312db: Status 404 returned error can't find the container with id 92b7fdc9475555fb96125a9170aa5cf62487ce3210d22cb67bb88c7bce4312db Jul 07 16:36:40.008784 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.008759 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:36:40.009191 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:36:40.009163 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2c6816_d6a1_4ccd_88ba_5d2f497b9405.slice/crio-3e07691946c9c73601ac52209a319d841b037210566c785f904243cbd3bb9f36 WatchSource:0}: Error finding container 3e07691946c9c73601ac52209a319d841b037210566c785f904243cbd3bb9f36: Status 404 returned error can't find the container with id 3e07691946c9c73601ac52209a319d841b037210566c785f904243cbd3bb9f36 Jul 07 16:36:40.182537 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.182479 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:40.283751 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.283715 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:40.704263 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.704190 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"e1445ff23dcfc4134b5fcf926b69e7e5483a331c618a0815aab752359e678a07"} Jul 07 16:36:40.706213 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.706108 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"3e07691946c9c73601ac52209a319d841b037210566c785f904243cbd3bb9f36"} Jul 07 16:36:40.715683 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.713396 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" event={"ID":"fb3df532-7276-424d-9dd4-5b5484102822","Type":"ContainerStarted","Data":"c9f1d2365fc92f6d84f037b9da2899f741020c96cc74b24088250979a9ef95ee"} Jul 07 16:36:40.715683 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.713456 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" event={"ID":"fb3df532-7276-424d-9dd4-5b5484102822","Type":"ContainerStarted","Data":"31e2925748d27cac16b5faa87180c5fa823477555f4ce670ed67552eb069de13"} Jul 07 16:36:40.715683 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.714752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" event={"ID":"054e738a-53ff-435a-9ac1-18edfecc9e92","Type":"ContainerStarted","Data":"92b7fdc9475555fb96125a9170aa5cf62487ce3210d22cb67bb88c7bce4312db"} Jul 07 16:36:40.719357 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.716900 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5zjnp" event={"ID":"62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0","Type":"ContainerStarted","Data":"fe73b66307d6ed2c36132ab0369220ccf0e113b977035aa896ff4258ab46526a"} Jul 07 16:36:40.719357 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.717757 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:40.723359 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.722883 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5zjnp" Jul 07 16:36:40.747029 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.746299 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dt8kh" podStartSLOduration=9.899358497 podStartE2EDuration="11.746280999s" totalImagesPullingTime="1.846922502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:40.744533652 +0000 UTC m=+98.050018268" watchObservedRunningTime="2026-07-07 16:36:40.746280999 +0000 UTC m=+98.051765622" Jul 07 16:36:40.797014 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:40.794881 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5zjnp" podStartSLOduration=2.262772328 podStartE2EDuration="22.794861243s" totalImagesPullingTime="20.532088915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:40.794122336 +0000 UTC m=+98.099606975" watchObservedRunningTime="2026-07-07 16:36:40.794861243 +0000 UTC m=+98.100345876" Jul 07 16:36:41.216127 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:41.215361 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-698cf5c9bd-4t7jl"] Jul 07 16:36:41.348461 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:41.346210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:41.449338 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:41.449283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:44.540066 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.540038 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6gt9j" Jul 07 16:36:44.740576 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.740535 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" event={"ID":"054e738a-53ff-435a-9ac1-18edfecc9e92","Type":"ContainerStarted","Data":"649674b5d6d9d16290bf65bbdc4e39928dc2a76d810e43c74a0e4569b942c2e8"} Jul 07 16:36:44.740775 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.740602 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:44.743367 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.743336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"5a99eee1b9d72809ca9ad3eab5b98701a323658445e231738e65b441d006a7fb"} Jul 07 16:36:44.743502 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.743416 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"b0a32ed1e789539bd5d0e1e4f03f8250b839244084f5a9530241e036ca57aceb"} Jul 07 16:36:44.743502 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.743460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"f953d70e50aa329822c3c9b0bf5f02fbfbe2e07d5dc1881514dccc84fdaeb56d"} Jul 07 16:36:44.745087 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.745061 2555 generic.go:356] "Generic (PLEG): container finished" podID="6f2c6816-d6a1-4ccd-88ba-5d2f497b9405" containerID="76dad7ecfa7719d98164c2e534e82daf65055f47ceb268c73d17a75edb46ebf3" exitCode=0 Jul 07 16:36:44.745213 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.745101 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerDied","Data":"76dad7ecfa7719d98164c2e534e82daf65055f47ceb268c73d17a75edb46ebf3"} Jul 07 16:36:44.746706 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.746657 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" Jul 07 16:36:44.763276 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:44.763227 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bfhsd" podStartSLOduration=6.741331163 podStartE2EDuration="10.763213622s" totalImagesPullingTime="4.021882459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:44.761829177 +0000 UTC m=+102.067313828" watchObservedRunningTime="2026-07-07 16:36:44.763213622 +0000 UTC m=+102.068698254" Jul 07 16:36:46.178288 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.178262 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:46.281485 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.281441 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:46.483291 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.483254 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:46.578703 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.578655 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:46.760030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.759945 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"3c3af6a32ecc688c11d67a29eaee921f81d51f0a4753e04b6fc8ac722adb4764"} Jul 07 16:36:46.760227 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.760031 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"876598f056345157af9a2410f611bdae4cfba221cfda811156d926735b06005f"} Jul 07 16:36:46.760227 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.760073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" event={"ID":"1d5eee0b-4e51-47a4-b854-f797ff54c488","Type":"ContainerStarted","Data":"5a444307a5c438fc652cddc9ff27f402595f7d7e9d16cf31d25383978ee3dce3"} Jul 07 16:36:46.760394 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.760372 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:46.792331 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.792272 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" podStartSLOduration=9.865832095 podStartE2EDuration="15.792254439s" totalImagesPullingTime="5.926422344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:46.790785221 +0000 UTC m=+104.096269864" watchObservedRunningTime="2026-07-07 16:36:46.792254439 +0000 UTC m=+104.097739063" Jul 07 16:36:46.878425 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.878397 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:46.962579 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:46.962517 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:47.780191 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:47.780100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:47.883251 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:47.883206 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:47.984325 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:47.984295 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:48.085143 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:48.085014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:49.777862 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.777784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"668e803e170c36c7d52ca2ed91d3279b2c362b92b157bfbc327b4cb275377e2f"} Jul 07 16:36:49.777862 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.777844 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"b2d7b3f2d08760a2cee0bd72a2eb7181a7e46d2d1a499dfa6f3e86073a1589bd"} Jul 07 16:36:49.778305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.777871 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"5c70efa554ae21b11dc9425b850be4737e4e22748a2ecf9d476d15acabd01901"} Jul 07 16:36:49.778305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.777897 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"436d685080395e82e333e1ec6c00917629e4ac3b961a624a4b309ece8f3a9715"} Jul 07 16:36:49.778305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.777919 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"974a791a06e5f997da3f03ad573830787756aee1b463e0983b81624d72ae967c"} Jul 07 16:36:49.778305 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.777942 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f2c6816-d6a1-4ccd-88ba-5d2f497b9405","Type":"ContainerStarted","Data":"152404bfd3c2d6074b0f68c36d341db4e00cd45ea211e2d0240ceba4b210ab7b"} Jul 07 16:36:49.831616 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:49.829236 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.565429323 podStartE2EDuration="13.829216849s" totalImagesPullingTime="8.234688553s" totalInitContainerRuntime="29.098973ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:36:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:36:49.825788983 +0000 UTC m=+107.131273606" watchObservedRunningTime="2026-07-07 16:36:49.829216849 +0000 UTC m=+107.134701466" Jul 07 16:36:50.413123 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:50.413095 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b644444d-42sgh"] Jul 07 16:36:50.578100 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:50.578071 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:50.671682 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:50.671638 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:50.777266 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:50.777239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:51.615985 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:51.615960 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:36:52.771702 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:52.771675 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c8cf75f58-5hnz8" Jul 07 16:36:55.627339 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:55.627311 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:55.723655 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:55.723624 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:55.996592 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:55.996543 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:36:56.097497 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:36:56.097430 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:00.313016 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.312972 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bf7cf547b-frvzl" podUID="1c18a2fe-decc-439e-831d-c794b4a583ca" containerName="console" containerID="cri-o://432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c" gracePeriod=15 Jul 07 16:37:00.600796 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.600771 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:37:00.690728 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.690704 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-console-config\") pod \"1c18a2fe-decc-439e-831d-c794b4a583ca\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " Jul 07 16:37:00.690865 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.690762 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-service-ca\") pod \"1c18a2fe-decc-439e-831d-c794b4a583ca\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " Jul 07 16:37:00.690865 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.690795 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-oauth-serving-cert\") pod \"1c18a2fe-decc-439e-831d-c794b4a583ca\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " Jul 07 16:37:00.690865 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.690832 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvpp5\" (UniqueName: \"kubernetes.io/projected/1c18a2fe-decc-439e-831d-c794b4a583ca-kube-api-access-fvpp5\") pod \"1c18a2fe-decc-439e-831d-c794b4a583ca\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " Jul 07 16:37:00.690989 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.690871 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-oauth-config\") pod \"1c18a2fe-decc-439e-831d-c794b4a583ca\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " Jul 07 16:37:00.690989 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.690901 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-serving-cert\") pod \"1c18a2fe-decc-439e-831d-c794b4a583ca\" (UID: \"1c18a2fe-decc-439e-831d-c794b4a583ca\") " Jul 07 16:37:00.691188 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.691164 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-console-config" (OuterVolumeSpecName: "console-config") pod "1c18a2fe-decc-439e-831d-c794b4a583ca" (UID: "1c18a2fe-decc-439e-831d-c794b4a583ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:00.691188 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.691175 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c18a2fe-decc-439e-831d-c794b4a583ca" (UID: "1c18a2fe-decc-439e-831d-c794b4a583ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:00.691313 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.691166 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c18a2fe-decc-439e-831d-c794b4a583ca" (UID: "1c18a2fe-decc-439e-831d-c794b4a583ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:00.693149 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.693108 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c18a2fe-decc-439e-831d-c794b4a583ca-kube-api-access-fvpp5" (OuterVolumeSpecName: "kube-api-access-fvpp5") pod "1c18a2fe-decc-439e-831d-c794b4a583ca" (UID: "1c18a2fe-decc-439e-831d-c794b4a583ca"). InnerVolumeSpecName "kube-api-access-fvpp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:37:00.693253 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.693124 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c18a2fe-decc-439e-831d-c794b4a583ca" (UID: "1c18a2fe-decc-439e-831d-c794b4a583ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:37:00.693253 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.693220 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c18a2fe-decc-439e-831d-c794b4a583ca" (UID: "1c18a2fe-decc-439e-831d-c794b4a583ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:37:00.792357 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.792334 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-service-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:00.792357 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.792356 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-oauth-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:00.792474 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.792366 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvpp5\" (UniqueName: \"kubernetes.io/projected/1c18a2fe-decc-439e-831d-c794b4a583ca-kube-api-access-fvpp5\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:00.792474 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.792375 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-oauth-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:00.792474 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.792384 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c18a2fe-decc-439e-831d-c794b4a583ca-console-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:00.792474 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.792392 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c18a2fe-decc-439e-831d-c794b4a583ca-console-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:00.823220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.823162 2555 generic.go:356] "Generic (PLEG): container finished" podID="1c18a2fe-decc-439e-831d-c794b4a583ca" containerID="432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c" exitCode=0 Jul 07 16:37:00.823220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.823205 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7cf547b-frvzl" Jul 07 16:37:00.823333 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.823235 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7cf547b-frvzl" event={"ID":"1c18a2fe-decc-439e-831d-c794b4a583ca","Type":"ContainerDied","Data":"432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c"} Jul 07 16:37:00.823333 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.823307 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7cf547b-frvzl" event={"ID":"1c18a2fe-decc-439e-831d-c794b4a583ca","Type":"ContainerDied","Data":"d9c710950cb77a56010f2d33e281ae287ee02f1fd4d856e011b8fd1de3857a87"} Jul 07 16:37:00.823333 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.823327 2555 scope.go:117] "RemoveContainer" containerID="432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c" Jul 07 16:37:00.831786 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.831769 2555 scope.go:117] "RemoveContainer" containerID="432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c" Jul 07 16:37:00.832037 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:37:00.832015 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c\": container with ID starting with 432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c not found: ID does not exist" containerID="432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c" Jul 07 16:37:00.832120 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.832043 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c"} err="failed to get container status \"432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c\": rpc error: code = NotFound desc = could not find container \"432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c\": container with ID starting with 432fa617600656acd65cff23d053a21b051b7f01c892fb6379e7e47ea957f16c not found: ID does not exist" Jul 07 16:37:00.851445 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.851422 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf7cf547b-frvzl"] Jul 07 16:37:00.855729 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:00.855711 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf7cf547b-frvzl"] Jul 07 16:37:01.286747 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:01.286710 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c18a2fe-decc-439e-831d-c794b4a583ca" path="/var/lib/kubelet/pods/1c18a2fe-decc-439e-831d-c794b4a583ca/volumes" Jul 07 16:37:06.250448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.250382 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" podUID="29907fbb-7dc2-404b-8e61-95c708baf822" containerName="registry" containerID="cri-o://463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469" gracePeriod=30 Jul 07 16:37:06.527209 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.527159 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:37:06.637562 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637515 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-bound-sa-token\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637566 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-registry-certificates\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637614 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-installation-pull-secrets\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637633 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-image-registry-private-configuration\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637656 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-trusted-ca\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637687 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637675 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637936 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637712 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhc8w\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-kube-api-access-hhc8w\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.637936 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.637753 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29907fbb-7dc2-404b-8e61-95c708baf822-ca-trust-extracted\") pod \"29907fbb-7dc2-404b-8e61-95c708baf822\" (UID: \"29907fbb-7dc2-404b-8e61-95c708baf822\") " Jul 07 16:37:06.638075 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.638029 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:06.638424 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.638361 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:06.640136 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.640099 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:37:06.640320 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.640293 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:37:06.640396 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.640347 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:37:06.640446 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.640410 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:37:06.640537 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.640495 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-kube-api-access-hhc8w" (OuterVolumeSpecName: "kube-api-access-hhc8w") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "kube-api-access-hhc8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:37:06.646405 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.646385 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29907fbb-7dc2-404b-8e61-95c708baf822-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "29907fbb-7dc2-404b-8e61-95c708baf822" (UID: "29907fbb-7dc2-404b-8e61-95c708baf822"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:37:06.738838 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738813 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-installation-pull-secrets\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738838 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738835 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29907fbb-7dc2-404b-8e61-95c708baf822-image-registry-private-configuration\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738845 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-trusted-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738854 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-registry-tls\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738864 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhc8w\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-kube-api-access-hhc8w\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738872 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29907fbb-7dc2-404b-8e61-95c708baf822-ca-trust-extracted\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738883 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29907fbb-7dc2-404b-8e61-95c708baf822-bound-sa-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.738950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.738892 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29907fbb-7dc2-404b-8e61-95c708baf822-registry-certificates\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:06.848375 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.848320 2555 generic.go:356] "Generic (PLEG): container finished" podID="29907fbb-7dc2-404b-8e61-95c708baf822" containerID="463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469" exitCode=0 Jul 07 16:37:06.848375 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.848359 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" Jul 07 16:37:06.848566 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.848394 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" event={"ID":"29907fbb-7dc2-404b-8e61-95c708baf822","Type":"ContainerDied","Data":"463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469"} Jul 07 16:37:06.848566 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.848448 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-698cf5c9bd-4t7jl" event={"ID":"29907fbb-7dc2-404b-8e61-95c708baf822","Type":"ContainerDied","Data":"b6a0a53b32f99a1194c9c06a2f0c79600e1a7acdf0d1e1c8aa2b3775b3424383"} Jul 07 16:37:06.848566 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.848477 2555 scope.go:117] "RemoveContainer" containerID="463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469" Jul 07 16:37:06.850030 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.850003 2555 generic.go:356] "Generic (PLEG): container finished" podID="cbdeb8a8-38dd-465e-a6a9-3c716c98577d" containerID="ee4f4136852a6e29eb8f3e91557c121ef5dfa81c3fc6961edf21792dbbbca56e" exitCode=0 Jul 07 16:37:06.850108 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.850054 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" event={"ID":"cbdeb8a8-38dd-465e-a6a9-3c716c98577d","Type":"ContainerDied","Data":"ee4f4136852a6e29eb8f3e91557c121ef5dfa81c3fc6961edf21792dbbbca56e"} Jul 07 16:37:06.850429 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.850414 2555 scope.go:117] "RemoveContainer" containerID="ee4f4136852a6e29eb8f3e91557c121ef5dfa81c3fc6961edf21792dbbbca56e" Jul 07 16:37:06.856591 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.856409 2555 scope.go:117] "RemoveContainer" containerID="463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469" Jul 07 16:37:06.856788 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:37:06.856707 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469\": container with ID starting with 463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469 not found: ID does not exist" containerID="463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469" Jul 07 16:37:06.856788 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.856765 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469"} err="failed to get container status \"463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469\": rpc error: code = NotFound desc = could not find container \"463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469\": container with ID starting with 463558a80e455997fb396c18cf001a988cb11f022a827de305d38cfb05291469 not found: ID does not exist" Jul 07 16:37:06.925795 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.922977 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-698cf5c9bd-4t7jl"] Jul 07 16:37:06.928929 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:06.928905 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-698cf5c9bd-4t7jl"] Jul 07 16:37:07.287387 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:07.287355 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29907fbb-7dc2-404b-8e61-95c708baf822" path="/var/lib/kubelet/pods/29907fbb-7dc2-404b-8e61-95c708baf822/volumes" Jul 07 16:37:07.856319 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:07.856285 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hlxnk" event={"ID":"cbdeb8a8-38dd-465e-a6a9-3c716c98577d","Type":"ContainerStarted","Data":"4b174f336810981851f8339704153477733d8fc8babaef93976077737167513b"} Jul 07 16:37:10.990596 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:10.990560 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:11.090400 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:11.090365 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:15.434500 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.434451 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69b644444d-42sgh" podUID="7c2a0711-d048-4ea8-9e77-1f0e21765158" containerName="console" containerID="cri-o://44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881" gracePeriod=15 Jul 07 16:37:15.713656 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.713593 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:37:15.814756 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814728 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-config\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.814872 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814769 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-serving-cert\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.814872 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814788 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-oauth-config\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.814872 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814821 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-trusted-ca-bundle\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.814872 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814841 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-oauth-serving-cert\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.815074 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814885 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djw24\" (UniqueName: \"kubernetes.io/projected/7c2a0711-d048-4ea8-9e77-1f0e21765158-kube-api-access-djw24\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.815074 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.814933 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-service-ca\") pod \"7c2a0711-d048-4ea8-9e77-1f0e21765158\" (UID: \"7c2a0711-d048-4ea8-9e77-1f0e21765158\") " Jul 07 16:37:15.815177 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.815154 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-config" (OuterVolumeSpecName: "console-config") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:15.815351 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.815325 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:15.815408 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.815353 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:15.815469 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.815438 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:37:15.816866 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.816841 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:37:15.816990 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.816972 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:37:15.817075 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.817056 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2a0711-d048-4ea8-9e77-1f0e21765158-kube-api-access-djw24" (OuterVolumeSpecName: "kube-api-access-djw24") pod "7c2a0711-d048-4ea8-9e77-1f0e21765158" (UID: "7c2a0711-d048-4ea8-9e77-1f0e21765158"). InnerVolumeSpecName "kube-api-access-djw24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:37:15.889567 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.889511 2555 generic.go:356] "Generic (PLEG): container finished" podID="7c2a0711-d048-4ea8-9e77-1f0e21765158" containerID="44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881" exitCode=0 Jul 07 16:37:15.889682 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.889586 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b644444d-42sgh" Jul 07 16:37:15.889682 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.889595 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b644444d-42sgh" event={"ID":"7c2a0711-d048-4ea8-9e77-1f0e21765158","Type":"ContainerDied","Data":"44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881"} Jul 07 16:37:15.889682 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.889665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b644444d-42sgh" event={"ID":"7c2a0711-d048-4ea8-9e77-1f0e21765158","Type":"ContainerDied","Data":"e35f135c5e2d957c1d081ee8b5aee350bf9662ef2b361ec019c7e91eeae4c7c2"} Jul 07 16:37:15.889830 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.889686 2555 scope.go:117] "RemoveContainer" containerID="44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881" Jul 07 16:37:15.898201 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.898186 2555 scope.go:117] "RemoveContainer" containerID="44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881" Jul 07 16:37:15.898454 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:37:15.898431 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881\": container with ID starting with 44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881 not found: ID does not exist" containerID="44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881" Jul 07 16:37:15.898515 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.898462 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881"} err="failed to get container status \"44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881\": rpc error: code = NotFound desc = could not find container \"44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881\": container with ID starting with 44e50529b8fd5dd52a871de167ff84019f51e5d213851c569e9966044fa83881 not found: ID does not exist" Jul 07 16:37:15.913258 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.913235 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b644444d-42sgh"] Jul 07 16:37:15.916117 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916087 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69b644444d-42sgh"] Jul 07 16:37:15.916272 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916252 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djw24\" (UniqueName: \"kubernetes.io/projected/7c2a0711-d048-4ea8-9e77-1f0e21765158-kube-api-access-djw24\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:15.916389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916274 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-service-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:15.916389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916288 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:15.916389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916299 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:15.916389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916310 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2a0711-d048-4ea8-9e77-1f0e21765158-console-oauth-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:15.916389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916322 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-trusted-ca-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:15.916389 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:15.916336 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2a0711-d048-4ea8-9e77-1f0e21765158-oauth-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:37:16.676589 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:16.676557 2555 patch_prober.go:28] interesting pod/console-69b644444d-42sgh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/health\": context deadline exceeded" start-of-body= Jul 07 16:37:16.676946 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:16.676624 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-69b644444d-42sgh" podUID="7c2a0711-d048-4ea8-9e77-1f0e21765158" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": context deadline exceeded" Jul 07 16:37:17.287506 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:17.287471 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2a0711-d048-4ea8-9e77-1f0e21765158" path="/var/lib/kubelet/pods/7c2a0711-d048-4ea8-9e77-1f0e21765158/volumes" Jul 07 16:37:36.616797 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:36.616755 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:37:36.632196 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:36.632173 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:37:36.994973 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:36.994951 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:37:46.101157 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:46.101123 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:46.205337 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:46.205303 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:46.317418 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:46.317374 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:46.411865 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:46.411788 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:46.500252 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:46.500227 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:47.000663 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:47.000634 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:47.195922 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:47.195890 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:57.241896 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:57.241805 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:57.345631 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:57.345600 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:57.442482 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:57.442453 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:58.124489 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:58.124455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:37:58.191832 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:37:58.191803 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:38:11.021034 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:38:11.020990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:38:11.259799 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:38:11.259765 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:38:28.449174 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:38:28.449138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:38:37.896739 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:38:37.896700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:38:56.342936 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:38:56.342900 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:38:56.417386 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:38:56.417349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:39:16.869316 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:39:16.869284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:39:16.963789 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:39:16.963758 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:39:20.526027 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:39:20.525980 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:39:57.262878 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:39:57.262841 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:40:03.114955 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:40:03.114917 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:41:02.579087 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:02.578983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:04.026453 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:04.026412 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:07.214269 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:07.214235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:07.293481 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:07.293452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:08.508379 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:08.508345 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:08.690977 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:08.690942 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:10.678267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:10.678230 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:11.052616 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:11.052510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:12.335247 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:12.335213 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:12.435861 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:12.435829 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:19.070897 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:19.070859 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:21.129777 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:21.129741 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:21.243764 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:21.243727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:24.308296 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:24.308242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:24.409914 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:24.409883 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:26.769126 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:26.769095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:31.901949 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:31.901907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:32.098854 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:32.098821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:41.911669 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:41.911637 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:43.911264 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:43.911228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:45.728976 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:45.728940 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:45.836689 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:45.836658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:52.556295 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:52.556263 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:41:52.655692 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:41:52.655659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:42:08.324454 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:08.324419 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:42:08.445340 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:08.445311 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:42:11.538238 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.538204 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:42:11.539791 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.539771 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn"] Jul 07 16:42:11.540067 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540056 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c18a2fe-decc-439e-831d-c794b4a583ca" containerName="console" Jul 07 16:42:11.540115 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540068 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c18a2fe-decc-439e-831d-c794b4a583ca" containerName="console" Jul 07 16:42:11.540115 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540085 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29907fbb-7dc2-404b-8e61-95c708baf822" containerName="registry" Jul 07 16:42:11.540115 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540090 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="29907fbb-7dc2-404b-8e61-95c708baf822" containerName="registry" Jul 07 16:42:11.540115 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540101 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2a0711-d048-4ea8-9e77-1f0e21765158" containerName="console" Jul 07 16:42:11.540115 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540107 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2a0711-d048-4ea8-9e77-1f0e21765158" containerName="console" Jul 07 16:42:11.540314 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540153 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c18a2fe-decc-439e-831d-c794b4a583ca" containerName="console" Jul 07 16:42:11.540314 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540160 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c2a0711-d048-4ea8-9e77-1f0e21765158" containerName="console" Jul 07 16:42:11.540314 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.540165 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="29907fbb-7dc2-404b-8e61-95c708baf822" containerName="registry" Jul 07 16:42:11.542252 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.542235 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.545414 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.545385 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 07 16:42:11.545571 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.545551 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-hq5xp\"" Jul 07 16:42:11.546609 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.546558 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 07 16:42:11.546725 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.546661 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 16:42:11.546725 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.546661 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 16:42:11.568209 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.568186 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn"] Jul 07 16:42:11.634652 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.634629 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwpp\" (UniqueName: \"kubernetes.io/projected/d5b715ee-37bf-417a-85b8-7581d8bf2b74-kube-api-access-8lwpp\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.634742 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.634682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d5b715ee-37bf-417a-85b8-7581d8bf2b74-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.634782 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.634745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5b715ee-37bf-417a-85b8-7581d8bf2b74-cert\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.735463 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.735437 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d5b715ee-37bf-417a-85b8-7581d8bf2b74-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.735597 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.735486 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5b715ee-37bf-417a-85b8-7581d8bf2b74-cert\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.735597 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.735546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwpp\" (UniqueName: \"kubernetes.io/projected/d5b715ee-37bf-417a-85b8-7581d8bf2b74-kube-api-access-8lwpp\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.736139 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.736110 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d5b715ee-37bf-417a-85b8-7581d8bf2b74-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.737556 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.737516 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5b715ee-37bf-417a-85b8-7581d8bf2b74-cert\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.750534 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.750492 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwpp\" (UniqueName: \"kubernetes.io/projected/d5b715ee-37bf-417a-85b8-7581d8bf2b74-kube-api-access-8lwpp\") pod \"kubeflow-trainer-controller-manager-558bf49b46-flhcn\" (UID: \"d5b715ee-37bf-417a-85b8-7581d8bf2b74\") " pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.841770 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.841699 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:42:11.862168 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.862148 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:11.993981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.993947 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn"] Jul 07 16:42:11.995251 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:42:11.995226 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5b715ee_37bf_417a_85b8_7581d8bf2b74.slice/crio-8daf16409c67d7df8e58060e3d7107e850a00771d6488e21970595263d3ec619 WatchSource:0}: Error finding container 8daf16409c67d7df8e58060e3d7107e850a00771d6488e21970595263d3ec619: Status 404 returned error can't find the container with id 8daf16409c67d7df8e58060e3d7107e850a00771d6488e21970595263d3ec619 Jul 07 16:42:11.997112 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:11.997094 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:42:12.008073 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:12.008051 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" event={"ID":"d5b715ee-37bf-417a-85b8-7581d8bf2b74","Type":"ContainerStarted","Data":"8daf16409c67d7df8e58060e3d7107e850a00771d6488e21970595263d3ec619"} Jul 07 16:42:14.620635 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:14.620554 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:42:15.023009 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:15.022977 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" event={"ID":"d5b715ee-37bf-417a-85b8-7581d8bf2b74","Type":"ContainerStarted","Data":"507cf1461396b8e20bf5309988805e617606737995e729c255a3010b8879a4c4"} Jul 07 16:42:15.023154 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:15.023082 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:42:15.042228 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:15.042179 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" podStartSLOduration=1.8540326390000001 podStartE2EDuration="4.042166201s" totalImagesPullingTime="2.188133562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:42:15.040365723 +0000 UTC m=+432.345850344" watchObservedRunningTime="2026-07-07 16:42:15.042166201 +0000 UTC m=+432.347650823" Jul 07 16:42:31.031787 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:42:31.031710 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-558bf49b46-flhcn" Jul 07 16:43:39.191577 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.191541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:43:39.291899 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.291861 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:43:39.355211 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.355178 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d"] Jul 07 16:43:39.357750 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.357733 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:43:39.361603 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.361583 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"openshift-service-ca.crt\"" Jul 07 16:43:39.362193 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.362175 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"kube-root-ca.crt\"" Jul 07 16:43:39.362273 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.362224 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-56bl4\"/\"default-dockercfg-qn957\"" Jul 07 16:43:39.371021 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.370998 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d"] Jul 07 16:43:39.380444 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.380417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:43:39.468993 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.468932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjwb9\" (UniqueName: \"kubernetes.io/projected/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d-kube-api-access-mjwb9\") pod \"progression-enabled-node-0-0-xb75d\" (UID: \"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d\") " pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:43:39.569503 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.569477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjwb9\" (UniqueName: \"kubernetes.io/projected/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d-kube-api-access-mjwb9\") pod \"progression-enabled-node-0-0-xb75d\" (UID: \"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d\") " pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:43:39.578906 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.578883 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjwb9\" (UniqueName: \"kubernetes.io/projected/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d-kube-api-access-mjwb9\") pod \"progression-enabled-node-0-0-xb75d\" (UID: \"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d\") " pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:43:39.667402 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.667367 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:43:39.795075 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:39.795026 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d"] Jul 07 16:43:39.797195 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:43:39.797168 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b4bc9b_3fda_46bc_8f1f_ba1a9c553b9d.slice/crio-37ca0a3ad3e145cd1aa98e6d787193e461f8daa418c5c6d79a7690b6d83eb43f WatchSource:0}: Error finding container 37ca0a3ad3e145cd1aa98e6d787193e461f8daa418c5c6d79a7690b6d83eb43f: Status 404 returned error can't find the container with id 37ca0a3ad3e145cd1aa98e6d787193e461f8daa418c5c6d79a7690b6d83eb43f Jul 07 16:43:40.349725 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:43:40.349694 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" event={"ID":"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d","Type":"ContainerStarted","Data":"37ca0a3ad3e145cd1aa98e6d787193e461f8daa418c5c6d79a7690b6d83eb43f"} Jul 07 16:45:09.347938 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:45:09.347898 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:45:49.894079 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:45:49.894038 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" event={"ID":"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d","Type":"ContainerStarted","Data":"a5ffff67e463a4c53a208542c6e9b5a59b8d36e4c53946006363e6482d3e55c6"} Jul 07 16:45:49.894483 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:45:49.894099 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:45:49.931383 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:45:49.931321 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" podStartSLOduration=1.707689476 podStartE2EDuration="2m10.93130028s" totalImagesPullingTime="2m9.223610804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:45:49.929320893 +0000 UTC m=+647.234805511" watchObservedRunningTime="2026-07-07 16:45:49.93130028 +0000 UTC m=+647.236784904" Jul 07 16:45:51.901035 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:45:51.901001 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:45:52.602532 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:45:52.602484 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:46:12.135094 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:12.135042 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerName="node" probeResult="failure" output="Get \"http://10.132.0.24:28080/metrics\": read tcp 10.132.0.2:57556->10.132.0.24:28080: read: connection reset by peer" Jul 07 16:46:12.898441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:12.898404 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerName="node" probeResult="failure" output="Get \"http://10.132.0.24:28080/metrics\": dial tcp 10.132.0.24:28080: connect: connection refused" Jul 07 16:46:12.898649 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:12.898540 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:46:12.898974 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:12.898946 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerName="node" probeResult="failure" output="Get \"http://10.132.0.24:28080/metrics\": dial tcp 10.132.0.24:28080: connect: connection refused" Jul 07 16:46:12.987928 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:12.987903 2555 generic.go:356] "Generic (PLEG): container finished" podID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerID="a5ffff67e463a4c53a208542c6e9b5a59b8d36e4c53946006363e6482d3e55c6" exitCode=0 Jul 07 16:46:12.988038 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:12.987974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" event={"ID":"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d","Type":"ContainerDied","Data":"a5ffff67e463a4c53a208542c6e9b5a59b8d36e4c53946006363e6482d3e55c6"} Jul 07 16:46:14.131394 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.131371 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:46:14.241907 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.241854 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjwb9\" (UniqueName: \"kubernetes.io/projected/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d-kube-api-access-mjwb9\") pod \"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d\" (UID: \"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d\") " Jul 07 16:46:14.243862 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.243837 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d-kube-api-access-mjwb9" (OuterVolumeSpecName: "kube-api-access-mjwb9") pod "05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" (UID: "05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d"). InnerVolumeSpecName "kube-api-access-mjwb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:46:14.342918 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.342894 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjwb9\" (UniqueName: \"kubernetes.io/projected/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d-kube-api-access-mjwb9\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:46:14.996118 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.996091 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" Jul 07 16:46:14.996267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.996117 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d" event={"ID":"05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d","Type":"ContainerDied","Data":"37ca0a3ad3e145cd1aa98e6d787193e461f8daa418c5c6d79a7690b6d83eb43f"} Jul 07 16:46:14.996267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:14.996161 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37ca0a3ad3e145cd1aa98e6d787193e461f8daa418c5c6d79a7690b6d83eb43f" Jul 07 16:46:15.952416 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.952382 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:46:15.975312 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.975288 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx"] Jul 07 16:46:15.975612 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.975600 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerName="node" Jul 07 16:46:15.975663 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.975615 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerName="node" Jul 07 16:46:15.975697 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.975682 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" containerName="node" Jul 07 16:46:15.997181 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.997160 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx"] Jul 07 16:46:15.997293 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:15.997245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:16.000388 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.000363 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"openshift-service-ca.crt\"" Jul 07 16:46:16.000512 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.000390 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"kube-root-ca.crt\"" Jul 07 16:46:16.000512 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.000415 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-56bl4\"/\"default-dockercfg-qn957\"" Jul 07 16:46:16.157241 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.157215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lp6n\" (UniqueName: \"kubernetes.io/projected/43cf09d6-3d2f-491d-8048-1bb8f26ce802-kube-api-access-5lp6n\") pod \"progression-disabled-node-0-0-dc9wx\" (UID: \"43cf09d6-3d2f-491d-8048-1bb8f26ce802\") " pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:16.258440 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.258368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lp6n\" (UniqueName: \"kubernetes.io/projected/43cf09d6-3d2f-491d-8048-1bb8f26ce802-kube-api-access-5lp6n\") pod \"progression-disabled-node-0-0-dc9wx\" (UID: \"43cf09d6-3d2f-491d-8048-1bb8f26ce802\") " pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:16.271412 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.271387 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lp6n\" (UniqueName: \"kubernetes.io/projected/43cf09d6-3d2f-491d-8048-1bb8f26ce802-kube-api-access-5lp6n\") pod \"progression-disabled-node-0-0-dc9wx\" (UID: \"43cf09d6-3d2f-491d-8048-1bb8f26ce802\") " pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:16.307266 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.307244 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:16.459664 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:16.459634 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx"] Jul 07 16:46:16.462294 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:46:16.462271 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43cf09d6_3d2f_491d_8048_1bb8f26ce802.slice/crio-24f073175bec1ac2114cb310f25474e0def9f0aca3e27b8d034a18a4959111d0 WatchSource:0}: Error finding container 24f073175bec1ac2114cb310f25474e0def9f0aca3e27b8d034a18a4959111d0: Status 404 returned error can't find the container with id 24f073175bec1ac2114cb310f25474e0def9f0aca3e27b8d034a18a4959111d0 Jul 07 16:46:17.011103 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:17.011039 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" event={"ID":"43cf09d6-3d2f-491d-8048-1bb8f26ce802","Type":"ContainerStarted","Data":"ad90a6b5c1da0700a1dbccc023f2744421a9d4970b47032c47a603b6566a3402"} Jul 07 16:46:17.011576 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:17.011147 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" event={"ID":"43cf09d6-3d2f-491d-8048-1bb8f26ce802","Type":"ContainerStarted","Data":"24f073175bec1ac2114cb310f25474e0def9f0aca3e27b8d034a18a4959111d0"} Jul 07 16:46:17.011576 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:17.011177 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:17.038090 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:17.038030 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" podStartSLOduration=2.038009492 podStartE2EDuration="2.038009492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:17.036322923 +0000 UTC m=+674.341807545" watchObservedRunningTime="2026-07-07 16:46:17.038009492 +0000 UTC m=+674.343494337" Jul 07 16:46:18.012609 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:18.012575 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jul 07 16:46:18.015608 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:18.015575 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jul 07 16:46:19.017303 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:19.017269 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:40.015732 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:40.015694 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerName="node" probeResult="failure" output="Get \"http://10.132.0.25:28080/metrics\": dial tcp 10.132.0.25:28080: connect: connection refused" Jul 07 16:46:40.113653 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:40.113626 2555 generic.go:356] "Generic (PLEG): container finished" podID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerID="ad90a6b5c1da0700a1dbccc023f2744421a9d4970b47032c47a603b6566a3402" exitCode=0 Jul 07 16:46:40.113787 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:40.113684 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" event={"ID":"43cf09d6-3d2f-491d-8048-1bb8f26ce802","Type":"ContainerDied","Data":"ad90a6b5c1da0700a1dbccc023f2744421a9d4970b47032c47a603b6566a3402"} Jul 07 16:46:41.253302 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:41.253280 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:41.334786 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:41.334758 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lp6n\" (UniqueName: \"kubernetes.io/projected/43cf09d6-3d2f-491d-8048-1bb8f26ce802-kube-api-access-5lp6n\") pod \"43cf09d6-3d2f-491d-8048-1bb8f26ce802\" (UID: \"43cf09d6-3d2f-491d-8048-1bb8f26ce802\") " Jul 07 16:46:41.336717 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:41.336692 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43cf09d6-3d2f-491d-8048-1bb8f26ce802-kube-api-access-5lp6n" (OuterVolumeSpecName: "kube-api-access-5lp6n") pod "43cf09d6-3d2f-491d-8048-1bb8f26ce802" (UID: "43cf09d6-3d2f-491d-8048-1bb8f26ce802"). InnerVolumeSpecName "kube-api-access-5lp6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:46:41.435419 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:41.435394 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lp6n\" (UniqueName: \"kubernetes.io/projected/43cf09d6-3d2f-491d-8048-1bb8f26ce802-kube-api-access-5lp6n\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:46:42.123974 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:42.123949 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" Jul 07 16:46:42.123974 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:42.123953 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx" event={"ID":"43cf09d6-3d2f-491d-8048-1bb8f26ce802","Type":"ContainerDied","Data":"24f073175bec1ac2114cb310f25474e0def9f0aca3e27b8d034a18a4959111d0"} Jul 07 16:46:42.124155 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:42.123998 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24f073175bec1ac2114cb310f25474e0def9f0aca3e27b8d034a18a4959111d0" Jul 07 16:46:50.978540 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.978488 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv"] Jul 07 16:46:50.978885 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.978787 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerName="node" Jul 07 16:46:50.978885 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.978798 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerName="node" Jul 07 16:46:50.978885 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.978865 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" containerName="node" Jul 07 16:46:50.980985 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.980963 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:46:50.981546 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.981499 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:46:50.983994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.983969 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"openshift-service-ca.crt\"" Jul 07 16:46:50.983994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.983986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"kube-root-ca.crt\"" Jul 07 16:46:50.984105 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.984069 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-56bl4\"/\"default-dockercfg-qn957\"" Jul 07 16:46:50.992155 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:50.992136 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv"] Jul 07 16:46:51.109436 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:51.109410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7sss\" (UniqueName: \"kubernetes.io/projected/01c555cd-60e9-4c11-b5d7-057492f5f42b-kube-api-access-g7sss\") pod \"progression-invalid-node-0-0-ksxhv\" (UID: \"01c555cd-60e9-4c11-b5d7-057492f5f42b\") " pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:46:51.210256 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:51.210229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7sss\" (UniqueName: \"kubernetes.io/projected/01c555cd-60e9-4c11-b5d7-057492f5f42b-kube-api-access-g7sss\") pod \"progression-invalid-node-0-0-ksxhv\" (UID: \"01c555cd-60e9-4c11-b5d7-057492f5f42b\") " pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:46:51.221222 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:51.221192 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7sss\" (UniqueName: \"kubernetes.io/projected/01c555cd-60e9-4c11-b5d7-057492f5f42b-kube-api-access-g7sss\") pod \"progression-invalid-node-0-0-ksxhv\" (UID: \"01c555cd-60e9-4c11-b5d7-057492f5f42b\") " pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:46:51.290634 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:51.290582 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:46:51.414715 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:51.414693 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv"] Jul 07 16:46:51.416929 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:46:51.416898 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c555cd_60e9_4c11_b5d7_057492f5f42b.slice/crio-154a021a4090058d36b8b6233740dcfe7fe44d782ed3ec75311c84e3bcd14759 WatchSource:0}: Error finding container 154a021a4090058d36b8b6233740dcfe7fe44d782ed3ec75311c84e3bcd14759: Status 404 returned error can't find the container with id 154a021a4090058d36b8b6233740dcfe7fe44d782ed3ec75311c84e3bcd14759 Jul 07 16:46:52.166755 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:52.166722 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" event={"ID":"01c555cd-60e9-4c11-b5d7-057492f5f42b","Type":"ContainerStarted","Data":"269470d14ac07408eeb5d2e73f43411bcfdc89e470621a4ab65af5090fc3618c"} Jul 07 16:46:52.167146 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:52.166769 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" event={"ID":"01c555cd-60e9-4c11-b5d7-057492f5f42b","Type":"ContainerStarted","Data":"154a021a4090058d36b8b6233740dcfe7fe44d782ed3ec75311c84e3bcd14759"} Jul 07 16:46:52.167146 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:52.166797 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:46:52.193474 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:52.193424 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" podStartSLOduration=2.193408239 podStartE2EDuration="2.193408239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:52.192888665 +0000 UTC m=+709.498373325" watchObservedRunningTime="2026-07-07 16:46:52.193408239 +0000 UTC m=+709.498892860" Jul 07 16:46:53.169719 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:46:53.169692 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:47:06.113406 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:06.113370 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:06.632884 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:06.632853 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:09.318810 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.318782 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4f544cb8-p96sj"] Jul 07 16:47:09.321120 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.321102 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.324383 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.324361 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:47:09.327178 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.327155 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:47:09.327178 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.327165 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fchdd\"" Jul 07 16:47:09.328182 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.328164 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:47:09.328267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.328227 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:47:09.328267 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.328235 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:47:09.335441 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.335422 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:47:09.344045 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.344026 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4f544cb8-p96sj"] Jul 07 16:47:09.441994 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.441968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21d56207-509d-44c8-921a-f5b3c94c3405-console-serving-cert\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.442132 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.441998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-trusted-ca-bundle\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.442132 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.442022 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-service-ca\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.442132 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.442042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-console-config\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.442132 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.442057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-oauth-serving-cert\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.442132 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.442104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21d56207-509d-44c8-921a-f5b3c94c3405-console-oauth-config\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.442292 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.442171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpwkv\" (UniqueName: \"kubernetes.io/projected/21d56207-509d-44c8-921a-f5b3c94c3405-kube-api-access-zpwkv\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.446913 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.446888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:09.543063 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21d56207-509d-44c8-921a-f5b3c94c3405-console-serving-cert\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-trusted-ca-bundle\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-service-ca\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-console-config\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543166 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543131 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-oauth-serving-cert\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543353 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543324 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21d56207-509d-44c8-921a-f5b3c94c3405-console-oauth-config\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543432 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpwkv\" (UniqueName: \"kubernetes.io/projected/21d56207-509d-44c8-921a-f5b3c94c3405-kube-api-access-zpwkv\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.543913 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543889 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-oauth-serving-cert\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.544011 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.543893 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-console-config\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.544071 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.544011 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-service-ca\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.544138 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.544121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d56207-509d-44c8-921a-f5b3c94c3405-trusted-ca-bundle\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.545677 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.545658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21d56207-509d-44c8-921a-f5b3c94c3405-console-serving-cert\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.545883 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.545863 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21d56207-509d-44c8-921a-f5b3c94c3405-console-oauth-config\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.549827 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.549798 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:09.553784 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.553762 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpwkv\" (UniqueName: \"kubernetes.io/projected/21d56207-509d-44c8-921a-f5b3c94c3405-kube-api-access-zpwkv\") pod \"console-5b4f544cb8-p96sj\" (UID: \"21d56207-509d-44c8-921a-f5b3c94c3405\") " pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.631063 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.631009 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:09.768836 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:09.768812 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4f544cb8-p96sj"] Jul 07 16:47:09.771126 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:47:09.771104 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d56207_509d_44c8_921a_f5b3c94c3405.slice/crio-52b2111fb3dc88c1466b1b33b5315af5ad993b5177b3cda66ce844d753ec8ff2 WatchSource:0}: Error finding container 52b2111fb3dc88c1466b1b33b5315af5ad993b5177b3cda66ce844d753ec8ff2: Status 404 returned error can't find the container with id 52b2111fb3dc88c1466b1b33b5315af5ad993b5177b3cda66ce844d753ec8ff2 Jul 07 16:47:10.141016 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:10.140983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:10.243345 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:10.243316 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4f544cb8-p96sj" event={"ID":"21d56207-509d-44c8-921a-f5b3c94c3405","Type":"ContainerStarted","Data":"925854d9a511cc6dafae77b707fa56a99e4a27385c80e52ab2ba30ab7a60b5f3"} Jul 07 16:47:10.243483 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:10.243361 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4f544cb8-p96sj" event={"ID":"21d56207-509d-44c8-921a-f5b3c94c3405","Type":"ContainerStarted","Data":"52b2111fb3dc88c1466b1b33b5315af5ad993b5177b3cda66ce844d753ec8ff2"} Jul 07 16:47:10.269730 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:10.269682 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4f544cb8-p96sj" podStartSLOduration=1.269667055 podStartE2EDuration="1.269667055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:10.267881392 +0000 UTC m=+727.573366014" watchObservedRunningTime="2026-07-07 16:47:10.269667055 +0000 UTC m=+727.575151677" Jul 07 16:47:14.443039 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:14.443002 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": read tcp 10.132.0.2:41442->10.132.0.26:28080: read: connection reset by peer" Jul 07 16:47:15.167626 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:15.167592 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 07 16:47:15.167779 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:15.167688 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:47:15.168053 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:15.168030 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 07 16:47:15.267327 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:15.267301 2555 generic.go:356] "Generic (PLEG): container finished" podID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerID="269470d14ac07408eeb5d2e73f43411bcfdc89e470621a4ab65af5090fc3618c" exitCode=0 Jul 07 16:47:15.267461 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:15.267372 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" event={"ID":"01c555cd-60e9-4c11-b5d7-057492f5f42b","Type":"ContainerDied","Data":"269470d14ac07408eeb5d2e73f43411bcfdc89e470621a4ab65af5090fc3618c"} Jul 07 16:47:16.402906 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:16.402884 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:47:16.493902 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:16.493872 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7sss\" (UniqueName: \"kubernetes.io/projected/01c555cd-60e9-4c11-b5d7-057492f5f42b-kube-api-access-g7sss\") pod \"01c555cd-60e9-4c11-b5d7-057492f5f42b\" (UID: \"01c555cd-60e9-4c11-b5d7-057492f5f42b\") " Jul 07 16:47:16.495867 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:16.495840 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c555cd-60e9-4c11-b5d7-057492f5f42b-kube-api-access-g7sss" (OuterVolumeSpecName: "kube-api-access-g7sss") pod "01c555cd-60e9-4c11-b5d7-057492f5f42b" (UID: "01c555cd-60e9-4c11-b5d7-057492f5f42b"). InnerVolumeSpecName "kube-api-access-g7sss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:47:16.594886 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:16.594832 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7sss\" (UniqueName: \"kubernetes.io/projected/01c555cd-60e9-4c11-b5d7-057492f5f42b-kube-api-access-g7sss\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:47:17.277461 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:17.277435 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" Jul 07 16:47:17.277681 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:17.277460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv" event={"ID":"01c555cd-60e9-4c11-b5d7-057492f5f42b","Type":"ContainerDied","Data":"154a021a4090058d36b8b6233740dcfe7fe44d782ed3ec75311c84e3bcd14759"} Jul 07 16:47:17.277681 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:17.277499 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="154a021a4090058d36b8b6233740dcfe7fe44d782ed3ec75311c84e3bcd14759" Jul 07 16:47:19.631111 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:19.631080 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:19.631500 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:19.631131 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:19.635892 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:19.635872 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:20.295192 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:20.295165 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4f544cb8-p96sj" Jul 07 16:47:20.459968 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:20.459941 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:20.560672 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:20.560587 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:47:20.662186 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:47:20.662157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:48:29.660331 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:48:29.660244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:40.840662 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.840624 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:40.889362 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.889336 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f"] Jul 07 16:49:40.889651 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.889638 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerName="node" Jul 07 16:49:40.889696 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.889652 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerName="node" Jul 07 16:49:40.889734 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.889710 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" containerName="node" Jul 07 16:49:40.891864 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.891850 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:40.894668 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.894641 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-56bl4\"/\"default-dockercfg-qn957\"" Jul 07 16:49:40.894846 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.894824 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"openshift-service-ca.crt\"" Jul 07 16:49:40.895802 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.895782 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-56bl4\"/\"kube-root-ca.crt\"" Jul 07 16:49:40.905864 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:40.905840 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f"] Jul 07 16:49:41.008696 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.008670 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5spxv\" (UniqueName: \"kubernetes.io/projected/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d-kube-api-access-5spxv\") pod \"progression-no-metrics-node-0-0-wq56f\" (UID: \"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d\") " pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:41.109984 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.109914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5spxv\" (UniqueName: \"kubernetes.io/projected/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d-kube-api-access-5spxv\") pod \"progression-no-metrics-node-0-0-wq56f\" (UID: \"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d\") " pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:41.120006 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.119978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5spxv\" (UniqueName: \"kubernetes.io/projected/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d-kube-api-access-5spxv\") pod \"progression-no-metrics-node-0-0-wq56f\" (UID: \"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d\") " pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:41.200882 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.200858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:41.329607 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.329584 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f"] Jul 07 16:49:41.331919 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:49:41.331897 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b69e9f_3124_4bf6_9714_d2848f0b0e6d.slice/crio-5c82b90b57579d796db8706e42e4432425a15168cc810d82e904e9389ed12884 WatchSource:0}: Error finding container 5c82b90b57579d796db8706e42e4432425a15168cc810d82e904e9389ed12884: Status 404 returned error can't find the container with id 5c82b90b57579d796db8706e42e4432425a15168cc810d82e904e9389ed12884 Jul 07 16:49:41.920959 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.920925 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" event={"ID":"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d","Type":"ContainerStarted","Data":"4bf46c580354812b225fc5e70415218486a54b0756eb7af7a1d05eb922d92b8d"} Jul 07 16:49:41.921300 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.920977 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" event={"ID":"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d","Type":"ContainerStarted","Data":"5c82b90b57579d796db8706e42e4432425a15168cc810d82e904e9389ed12884"} Jul 07 16:49:41.940943 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:41.940899 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" podStartSLOduration=1.940884794 podStartE2EDuration="1.940884794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:49:41.938863254 +0000 UTC m=+879.244347896" watchObservedRunningTime="2026-07-07 16:49:41.940884794 +0000 UTC m=+879.246369416" Jul 07 16:49:46.943003 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:46.942946 2555 generic.go:356] "Generic (PLEG): container finished" podID="a3b69e9f-3124-4bf6-9714-d2848f0b0e6d" containerID="4bf46c580354812b225fc5e70415218486a54b0756eb7af7a1d05eb922d92b8d" exitCode=0 Jul 07 16:49:46.943380 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:46.943026 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" event={"ID":"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d","Type":"ContainerDied","Data":"4bf46c580354812b225fc5e70415218486a54b0756eb7af7a1d05eb922d92b8d"} Jul 07 16:49:48.077371 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.077346 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:48.159183 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.159155 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5spxv\" (UniqueName: \"kubernetes.io/projected/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d-kube-api-access-5spxv\") pod \"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d\" (UID: \"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d\") " Jul 07 16:49:48.161083 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.161058 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d-kube-api-access-5spxv" (OuterVolumeSpecName: "kube-api-access-5spxv") pod "a3b69e9f-3124-4bf6-9714-d2848f0b0e6d" (UID: "a3b69e9f-3124-4bf6-9714-d2848f0b0e6d"). InnerVolumeSpecName "kube-api-access-5spxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:49:48.260427 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.260376 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5spxv\" (UniqueName: \"kubernetes.io/projected/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d-kube-api-access-5spxv\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:49:48.954875 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.954845 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" Jul 07 16:49:48.955049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.954845 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f" event={"ID":"a3b69e9f-3124-4bf6-9714-d2848f0b0e6d","Type":"ContainerDied","Data":"5c82b90b57579d796db8706e42e4432425a15168cc810d82e904e9389ed12884"} Jul 07 16:49:48.955049 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:48.954990 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c82b90b57579d796db8706e42e4432425a15168cc810d82e904e9389ed12884" Jul 07 16:49:52.853676 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:52.853635 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:53.826537 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.826489 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f4vgc/must-gather-5lfcm"] Jul 07 16:49:53.826814 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.826802 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b69e9f-3124-4bf6-9714-d2848f0b0e6d" containerName="node" Jul 07 16:49:53.826857 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.826816 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b69e9f-3124-4bf6-9714-d2848f0b0e6d" containerName="node" Jul 07 16:49:53.826890 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.826872 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b69e9f-3124-4bf6-9714-d2848f0b0e6d" containerName="node" Jul 07 16:49:53.829052 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.829031 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:53.832666 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.832646 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4vgc\"/\"kube-root-ca.crt\"" Jul 07 16:49:53.833351 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.833334 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4vgc\"/\"openshift-service-ca.crt\"" Jul 07 16:49:53.834966 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.834947 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f4vgc\"/\"default-dockercfg-gfdj9\"" Jul 07 16:49:53.848096 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.848073 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4vgc/must-gather-5lfcm"] Jul 07 16:49:53.856431 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:53.856407 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:54.002883 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.002855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9npsr\" (UniqueName: \"kubernetes.io/projected/4463441d-a8b8-4901-9a2d-c9f817b546f1-kube-api-access-9npsr\") pod \"must-gather-5lfcm\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.003033 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.002908 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4463441d-a8b8-4901-9a2d-c9f817b546f1-must-gather-output\") pod \"must-gather-5lfcm\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.026761 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.026736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:54.103379 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.103327 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9npsr\" (UniqueName: \"kubernetes.io/projected/4463441d-a8b8-4901-9a2d-c9f817b546f1-kube-api-access-9npsr\") pod \"must-gather-5lfcm\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.103379 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.103369 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4463441d-a8b8-4901-9a2d-c9f817b546f1-must-gather-output\") pod \"must-gather-5lfcm\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.103683 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.103667 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4463441d-a8b8-4901-9a2d-c9f817b546f1-must-gather-output\") pod \"must-gather-5lfcm\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.124758 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.124734 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9npsr\" (UniqueName: \"kubernetes.io/projected/4463441d-a8b8-4901-9a2d-c9f817b546f1-kube-api-access-9npsr\") pod \"must-gather-5lfcm\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.138222 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.138202 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:49:54.275545 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.275507 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4vgc/must-gather-5lfcm"] Jul 07 16:49:54.277867 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:49:54.277836 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4463441d_a8b8_4901_9a2d_c9f817b546f1.slice/crio-1f45550315c0c0ea16fa9c66c8da8448fd397411bc0b2cf5ed90cd1875a21d54 WatchSource:0}: Error finding container 1f45550315c0c0ea16fa9c66c8da8448fd397411bc0b2cf5ed90cd1875a21d54: Status 404 returned error can't find the container with id 1f45550315c0c0ea16fa9c66c8da8448fd397411bc0b2cf5ed90cd1875a21d54 Jul 07 16:49:54.279708 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.279692 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:49:54.983222 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:54.983183 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" event={"ID":"4463441d-a8b8-4901-9a2d-c9f817b546f1","Type":"ContainerStarted","Data":"1f45550315c0c0ea16fa9c66c8da8448fd397411bc0b2cf5ed90cd1875a21d54"} Jul 07 16:49:57.929167 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:57.929128 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx"] Jul 07 16:49:57.935185 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:57.935161 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-56bl4/progression-disabled-node-0-0-dc9wx"] Jul 07 16:49:57.947714 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:57.947690 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d"] Jul 07 16:49:57.951471 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:57.951450 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-56bl4/progression-enabled-node-0-0-xb75d"] Jul 07 16:49:57.964019 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:57.963998 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv"] Jul 07 16:49:57.975981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:57.975950 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-56bl4/progression-invalid-node-0-0-ksxhv"] Jul 07 16:49:58.000469 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:58.000445 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f"] Jul 07 16:49:58.005714 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:58.005692 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-56bl4/progression-no-metrics-node-0-0-wq56f"] Jul 07 16:49:58.470011 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:58.469972 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:58.574954 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:58.574914 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:49:59.287539 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:59.287503 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c555cd-60e9-4c11-b5d7-057492f5f42b" path="/var/lib/kubelet/pods/01c555cd-60e9-4c11-b5d7-057492f5f42b/volumes" Jul 07 16:49:59.287950 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:59.287889 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d" path="/var/lib/kubelet/pods/05b4bc9b-3fda-46bc-8f1f-ba1a9c553b9d/volumes" Jul 07 16:49:59.288168 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:59.288153 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43cf09d6-3d2f-491d-8048-1bb8f26ce802" path="/var/lib/kubelet/pods/43cf09d6-3d2f-491d-8048-1bb8f26ce802/volumes" Jul 07 16:49:59.288432 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:59.288419 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3b69e9f-3124-4bf6-9714-d2848f0b0e6d" path="/var/lib/kubelet/pods/a3b69e9f-3124-4bf6-9714-d2848f0b0e6d/volumes" Jul 07 16:49:59.337613 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:49:59.337510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:01.020513 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:01.020476 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" event={"ID":"4463441d-a8b8-4901-9a2d-c9f817b546f1","Type":"ContainerStarted","Data":"60a6b2a78c7a3b6a57f3c9f0e492f1f07250a70d6088e624e799fd64bdfcb3c8"} Jul 07 16:50:01.020946 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:01.020544 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" event={"ID":"4463441d-a8b8-4901-9a2d-c9f817b546f1","Type":"ContainerStarted","Data":"198d5a94ed8d80583e0ee15f49e66fef955ac14e2c194dd5f3b6acdd28cc8cbf"} Jul 07 16:50:01.046769 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:01.046722 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" podStartSLOduration=2.074249265 podStartE2EDuration="8.046706444s" totalImagesPullingTime="5.972457179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:01.045448345 +0000 UTC m=+898.350932967" watchObservedRunningTime="2026-07-07 16:50:01.046706444 +0000 UTC m=+898.352191065" Jul 07 16:50:04.981440 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:04.981399 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:05.122136 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:05.122098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:09.735512 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:09.735479 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-558bf49b46-flhcn_d5b715ee-37bf-417a-85b8-7581d8bf2b74/manager/0.log" Jul 07 16:50:10.279771 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:10.279742 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-558bf49b46-flhcn_d5b715ee-37bf-417a-85b8-7581d8bf2b74/manager/0.log" Jul 07 16:50:10.796204 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:10.796173 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-558bf49b46-flhcn_d5b715ee-37bf-417a-85b8-7581d8bf2b74/manager/0.log" Jul 07 16:50:49.267448 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:49.267413 2555 generic.go:356] "Generic (PLEG): container finished" podID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerID="198d5a94ed8d80583e0ee15f49e66fef955ac14e2c194dd5f3b6acdd28cc8cbf" exitCode=0 Jul 07 16:50:49.269780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:49.267484 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" event={"ID":"4463441d-a8b8-4901-9a2d-c9f817b546f1","Type":"ContainerDied","Data":"198d5a94ed8d80583e0ee15f49e66fef955ac14e2c194dd5f3b6acdd28cc8cbf"} Jul 07 16:50:49.269780 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:49.267808 2555 scope.go:117] "RemoveContainer" containerID="198d5a94ed8d80583e0ee15f49e66fef955ac14e2c194dd5f3b6acdd28cc8cbf" Jul 07 16:50:49.781154 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:49.781127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4vgc_must-gather-5lfcm_4463441d-a8b8-4901-9a2d-c9f817b546f1/gather/0.log" Jul 07 16:50:50.192947 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:50.192911 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:50.363335 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:50.363296 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:50.463695 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:50.463622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:53.339971 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:53.339946 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7jqvn_9d57cce7-ddc8-47f9-9abb-307d0125974d/global-pull-secret-syncer/0.log" Jul 07 16:50:53.609877 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:53.609811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" Jul 07 16:50:53.872400 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:53.872323 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-167.ec2.internal_684e505a654ab219cfa598f20931a3ab/haproxy/0.log" Jul 07 16:50:55.161750 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.161719 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-f4vgc/must-gather-5lfcm"] Jul 07 16:50:55.162169 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.161896 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="copy" containerID="cri-o://60a6b2a78c7a3b6a57f3c9f0e492f1f07250a70d6088e624e799fd64bdfcb3c8" gracePeriod=2 Jul 07 16:50:55.169293 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.169271 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-f4vgc/must-gather-5lfcm"] Jul 07 16:50:55.170787 ip-10-0-136-167 kubenswrapper[2555]: E0707 16:50:55.170744 2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4463441d-a8b8-4901-9a2d-c9f817b546f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-f4vgc\"/\"must-gather-5lfcm\": pods \"must-gather-5lfcm\" not found" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:50:55.297182 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.297155 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4vgc_must-gather-5lfcm_4463441d-a8b8-4901-9a2d-c9f817b546f1/copy/0.log" Jul 07 16:50:55.297551 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.297507 2555 generic.go:356] "Generic (PLEG): container finished" podID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerID="60a6b2a78c7a3b6a57f3c9f0e492f1f07250a70d6088e624e799fd64bdfcb3c8" exitCode=143 Jul 07 16:50:55.400791 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.400771 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4vgc_must-gather-5lfcm_4463441d-a8b8-4901-9a2d-c9f817b546f1/copy/0.log" Jul 07 16:50:55.402981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.402964 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:50:55.425704 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.425679 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9npsr\" (UniqueName: \"kubernetes.io/projected/4463441d-a8b8-4901-9a2d-c9f817b546f1-kube-api-access-9npsr\") pod \"4463441d-a8b8-4901-9a2d-c9f817b546f1\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " Jul 07 16:50:55.425828 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.425733 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4463441d-a8b8-4901-9a2d-c9f817b546f1-must-gather-output\") pod \"4463441d-a8b8-4901-9a2d-c9f817b546f1\" (UID: \"4463441d-a8b8-4901-9a2d-c9f817b546f1\") " Jul 07 16:50:55.427213 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.427187 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4463441d-a8b8-4901-9a2d-c9f817b546f1-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "4463441d-a8b8-4901-9a2d-c9f817b546f1" (UID: "4463441d-a8b8-4901-9a2d-c9f817b546f1"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:50:55.427657 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.427636 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4463441d-a8b8-4901-9a2d-c9f817b546f1-kube-api-access-9npsr" (OuterVolumeSpecName: "kube-api-access-9npsr") pod "4463441d-a8b8-4901-9a2d-c9f817b546f1" (UID: "4463441d-a8b8-4901-9a2d-c9f817b546f1"). InnerVolumeSpecName "kube-api-access-9npsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:50:55.526869 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.526846 2555 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4463441d-a8b8-4901-9a2d-c9f817b546f1-must-gather-output\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:50:55.526869 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:55.526866 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9npsr\" (UniqueName: \"kubernetes.io/projected/4463441d-a8b8-4901-9a2d-c9f817b546f1-kube-api-access-9npsr\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 16:50:56.290545 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:56.290487 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:56.303480 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:56.303458 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4vgc_must-gather-5lfcm_4463441d-a8b8-4901-9a2d-c9f817b546f1/copy/0.log" Jul 07 16:50:56.303854 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:56.303841 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4vgc/must-gather-5lfcm" Jul 07 16:50:56.303912 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:56.303891 2555 scope.go:117] "RemoveContainer" containerID="60a6b2a78c7a3b6a57f3c9f0e492f1f07250a70d6088e624e799fd64bdfcb3c8" Jul 07 16:50:56.312542 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:56.312502 2555 scope.go:117] "RemoveContainer" containerID="198d5a94ed8d80583e0ee15f49e66fef955ac14e2c194dd5f3b6acdd28cc8cbf" Jul 07 16:50:56.394979 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:56.394949 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8mmjw_40354d1e-f46b-4d14-a595-cf1e198a7d0d/konnectivity-agent/0.log" limit=1024 Jul 07 16:50:57.153420 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.153351 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-vr97h_1fa3e5d2-2429-4d25-9abe-6c7a786f912f/cluster-monitoring-operator/0.log" Jul 07 16:50:57.186347 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.186325 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dt8kh_fb3df532-7276-424d-9dd4-5b5484102822/kube-state-metrics/0.log" Jul 07 16:50:57.213296 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.213261 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dt8kh_fb3df532-7276-424d-9dd4-5b5484102822/kube-rbac-proxy-main/0.log" Jul 07 16:50:57.258026 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.257998 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dt8kh_fb3df532-7276-424d-9dd4-5b5484102822/kube-rbac-proxy-self/0.log" Jul 07 16:50:57.287151 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.287127 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" path="/var/lib/kubelet/pods/4463441d-a8b8-4901-9a2d-c9f817b546f1/volumes" Jul 07 16:50:57.363059 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.363033 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-bfhsd_054e738a-53ff-435a-9ac1-18edfecc9e92/monitoring-plugin/0.log" Jul 07 16:50:57.401873 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.401855 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k2q9_fd68252f-8aa6-49e3-8f7b-e2170ae448ed/node-exporter/0.log" Jul 07 16:50:57.436342 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.436322 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k2q9_fd68252f-8aa6-49e3-8f7b-e2170ae448ed/kube-rbac-proxy/0.log" Jul 07 16:50:57.468334 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.468319 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k2q9_fd68252f-8aa6-49e3-8f7b-e2170ae448ed/init-textfile/0.log" Jul 07 16:50:57.910768 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.910740 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/prometheus/0.log" Jul 07 16:50:57.962917 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:57.962864 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/config-reloader/0.log" Jul 07 16:50:58.021227 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.021205 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/thanos-sidecar/0.log" Jul 07 16:50:58.057477 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.057459 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/kube-rbac-proxy-web/0.log" Jul 07 16:50:58.094948 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.094928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/kube-rbac-proxy/0.log" Jul 07 16:50:58.144084 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.144064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/kube-rbac-proxy-thanos/0.log" Jul 07 16:50:58.194334 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.194314 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f2c6816-d6a1-4ccd-88ba-5d2f497b9405/init-config-reloader/0.log" Jul 07 16:50:58.257327 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.257276 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-rd4ng_c22e0e90-fa1a-4f37-8987-ca92d42fa5c5/prometheus-operator/0.log" Jul 07 16:50:58.298039 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.298017 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-rd4ng_c22e0e90-fa1a-4f37-8987-ca92d42fa5c5/kube-rbac-proxy/0.log" Jul 07 16:50:58.387071 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.387049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-8rzdj_b47d1c24-65a7-475c-95cd-b556bdb9d19d/prometheus-operator-admission-webhook/0.log" Jul 07 16:50:58.615332 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.615262 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cf75f58-5hnz8_1d5eee0b-4e51-47a4-b854-f797ff54c488/thanos-query/0.log" Jul 07 16:50:58.658220 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.658200 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cf75f58-5hnz8_1d5eee0b-4e51-47a4-b854-f797ff54c488/kube-rbac-proxy-web/0.log" Jul 07 16:50:58.756612 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.756585 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cf75f58-5hnz8_1d5eee0b-4e51-47a4-b854-f797ff54c488/kube-rbac-proxy/0.log" Jul 07 16:50:58.852969 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.852951 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cf75f58-5hnz8_1d5eee0b-4e51-47a4-b854-f797ff54c488/prom-label-proxy/0.log" Jul 07 16:50:58.946429 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:58.946407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cf75f58-5hnz8_1d5eee0b-4e51-47a4-b854-f797ff54c488/kube-rbac-proxy-rules/0.log" Jul 07 16:50:59.005192 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:50:59.005175 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cf75f58-5hnz8_1d5eee0b-4e51-47a4-b854-f797ff54c488/kube-rbac-proxy-metrics/0.log" Jul 07 16:51:00.016626 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.016589 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-wqx9q_c75f1b45-79db-4c42-966f-bc789956dde2/networking-console-plugin/0.log" Jul 07 16:51:00.223720 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.223690 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4"] Jul 07 16:51:00.223995 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.223983 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="copy" Jul 07 16:51:00.224039 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.223996 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="copy" Jul 07 16:51:00.224039 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.224016 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="gather" Jul 07 16:51:00.224039 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.224022 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="gather" Jul 07 16:51:00.224126 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.224068 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="copy" Jul 07 16:51:00.224126 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.224078 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4463441d-a8b8-4901-9a2d-c9f817b546f1" containerName="gather" Jul 07 16:51:00.226866 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.226843 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.230623 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.230602 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ptqgx\"/\"kube-root-ca.crt\"" Jul 07 16:51:00.230761 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.230671 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ptqgx\"/\"default-dockercfg-kv7wf\"" Jul 07 16:51:00.231774 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.231758 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ptqgx\"/\"openshift-service-ca.crt\"" Jul 07 16:51:00.246467 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.246446 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4"] Jul 07 16:51:00.259419 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.259401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-sys\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.259543 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.259435 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-proc\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.259543 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.259455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-podres\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.259543 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.259505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmlc4\" (UniqueName: \"kubernetes.io/projected/7cadee1a-3422-4a7a-9da1-69177175be89-kube-api-access-bmlc4\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.259699 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.259609 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-lib-modules\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360612 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-lib-modules\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360612 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-sys\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-proc\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-podres\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmlc4\" (UniqueName: \"kubernetes.io/projected/7cadee1a-3422-4a7a-9da1-69177175be89-kube-api-access-bmlc4\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360714 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-lib-modules\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360724 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-proc\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360925 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360741 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-sys\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.360925 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.360766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7cadee1a-3422-4a7a-9da1-69177175be89-podres\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.371289 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.371269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmlc4\" (UniqueName: \"kubernetes.io/projected/7cadee1a-3422-4a7a-9da1-69177175be89-kube-api-access-bmlc4\") pod \"perf-node-gather-daemonset-t5cf4\" (UID: \"7cadee1a-3422-4a7a-9da1-69177175be89\") " pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.536659 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.536635 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:00.692116 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:00.692092 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4"] Jul 07 16:51:00.693841 ip-10-0-136-167 kubenswrapper[2555]: W0707 16:51:00.693813 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7cadee1a_3422_4a7a_9da1_69177175be89.slice/crio-425a87469177a2bf17f2bc80b0681f5e8e20276ddfa558c2ecde3f1474c18b73 WatchSource:0}: Error finding container 425a87469177a2bf17f2bc80b0681f5e8e20276ddfa558c2ecde3f1474c18b73: Status 404 returned error can't find the container with id 425a87469177a2bf17f2bc80b0681f5e8e20276ddfa558c2ecde3f1474c18b73 Jul 07 16:51:01.051860 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:01.051830 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b4f544cb8-p96sj_21d56207-509d-44c8-921a-f5b3c94c3405/console/0.log" Jul 07 16:51:01.102723 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:01.102703 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5zjnp_62f9d2a1-8ebc-4fde-8ecb-45fbe4a6d2b0/download-server/0.log" Jul 07 16:51:01.327741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:01.327677 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" event={"ID":"7cadee1a-3422-4a7a-9da1-69177175be89","Type":"ContainerStarted","Data":"e5da6580db65fd54278ae31c9998ac9eb8d1515eb0bf5c620896096e801b3bcf"} Jul 07 16:51:01.327741 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:01.327722 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" event={"ID":"7cadee1a-3422-4a7a-9da1-69177175be89","Type":"ContainerStarted","Data":"425a87469177a2bf17f2bc80b0681f5e8e20276ddfa558c2ecde3f1474c18b73"} Jul 07 16:51:01.327891 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:01.327778 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:01.366603 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:01.366567 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" podStartSLOduration=1.3665552779999999 podStartE2EDuration="1.366555278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:51:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:51:01.365100668 +0000 UTC m=+958.670585290" watchObservedRunningTime="2026-07-07 16:51:01.366555278 +0000 UTC m=+958.672039899" Jul 07 16:51:02.716753 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:02.716720 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qwn9n_33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa/dns/0.log" Jul 07 16:51:02.745494 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:02.745465 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qwn9n_33bed7f9-0e69-4fc5-a8f1-c3d1a242f0aa/kube-rbac-proxy/0.log" Jul 07 16:51:02.849594 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:02.849568 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vz7rh_2b1e6f79-37c1-4239-89e0-744d9e2a5862/dns-node-resolver/0.log" Jul 07 16:51:03.393738 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:03.393688 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cf2hz_22494f3d-9978-4b22-8ea6-4582900753e4/node-ca/0.log" Jul 07 16:51:04.233083 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:04.233049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5779866cb7-wjhtf_b83d95e4-4811-4a66-9363-4ae10f29a99e/router/0.log" Jul 07 16:51:04.567280 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:04.567200 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gbpt9_06a66a91-122b-41dd-b912-774a663fbc7f/serve-healthcheck-canary/0.log" Jul 07 16:51:05.084680 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:05.084646 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-hlxnk_cbdeb8a8-38dd-465e-a6a9-3c716c98577d/insights-operator/0.log" Jul 07 16:51:05.084850 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:05.084775 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-hlxnk_cbdeb8a8-38dd-465e-a6a9-3c716c98577d/insights-operator/1.log" Jul 07 16:51:05.110169 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:05.110137 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bj7kt_5f6693ac-bbca-4ad0-afb2-00bb8227c767/kube-rbac-proxy/0.log" Jul 07 16:51:05.136587 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:05.136565 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bj7kt_5f6693ac-bbca-4ad0-afb2-00bb8227c767/exporter/0.log" Jul 07 16:51:05.169113 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:05.169092 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bj7kt_5f6693ac-bbca-4ad0-afb2-00bb8227c767/extractor/0.log" Jul 07 16:51:07.340981 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:07.340953 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ptqgx/perf-node-gather-daemonset-t5cf4" Jul 07 16:51:12.502576 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.502550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/kube-multus-additional-cni-plugins/0.log" Jul 07 16:51:12.537481 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.537454 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/egress-router-binary-copy/0.log" Jul 07 16:51:12.567683 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.567655 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/cni-plugins/0.log" Jul 07 16:51:12.598595 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.598573 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/bond-cni-plugin/0.log" Jul 07 16:51:12.626561 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.626538 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/routeoverride-cni/0.log" Jul 07 16:51:12.651551 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.651513 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/whereabouts-cni-bincopy/0.log" Jul 07 16:51:12.680357 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.680339 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rccks_947bef53-3ed7-47b5-b17a-b5f1fe3f9288/whereabouts-cni/0.log" Jul 07 16:51:12.988359 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:12.988334 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q895n_ac160e25-d0ef-4276-9d27-654476ec96a2/kube-multus/0.log" Jul 07 16:51:13.099555 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:13.099535 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s785t_0703ddfb-7bf8-4e55-9f94-5cdb46f21879/network-metrics-daemon/0.log" Jul 07 16:51:13.141213 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:13.141191 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s785t_0703ddfb-7bf8-4e55-9f94-5cdb46f21879/kube-rbac-proxy/0.log" Jul 07 16:51:14.583991 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.583963 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/ovn-controller/0.log" Jul 07 16:51:14.610864 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.610838 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/ovn-acl-logging/0.log" Jul 07 16:51:14.639490 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.639465 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/kube-rbac-proxy-node/0.log" Jul 07 16:51:14.665083 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.665059 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 16:51:14.692289 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.692244 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/northd/0.log" Jul 07 16:51:14.722345 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.722327 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/nbdb/0.log" Jul 07 16:51:14.752815 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.752798 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/sbdb/0.log" Jul 07 16:51:14.816000 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:14.815981 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7vwl_7ee4c1e6-74ed-467b-ad97-9b1a5389908f/ovnkube-controller/0.log" Jul 07 16:51:15.898491 ip-10-0-136-167 kubenswrapper[2555]: I0707 16:51:15.898419 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6gt9j_ee5f53e4-c461-41bb-a77f-739f74bb4d23/network-check-target-container/0.log"