Jul 01 19:22:51.300511 ip-10-0-133-159 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:22:51.730167 ip-10-0-133-159 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:51.730167 ip-10-0-133-159 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:22:51.730167 ip-10-0-133-159 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:51.730167 ip-10-0-133-159 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:22:51.730167 ip-10-0-133-159 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:51.731906 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.731819 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:22:51.741128 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741110 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:51.741128 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741125 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:51.741128 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741129 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741133 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741137 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741140 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741143 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741146 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741149 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741154 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741157 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741160 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741163 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741166 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741169 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741171 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741174 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741181 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741184 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741187 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741189 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741192 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:51.741234 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741195 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741198 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741201 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741204 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741206 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741209 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741222 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741227 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741231 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741234 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741237 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741240 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741243 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741247 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741250 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741253 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741255 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741258 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741261 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741264 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:51.741733 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741267 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741270 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741272 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741275 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741278 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741281 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741284 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741288 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741291 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741293 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741296 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741298 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741301 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741304 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741307 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741310 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741313 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741316 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741318 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741321 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:51.742238 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741324 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741327 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741330 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741333 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741337 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741341 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741344 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741347 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741350 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741354 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741356 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741359 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741361 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741364 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741367 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741372 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741375 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741378 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741380 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:51.742766 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741383 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741388 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741391 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741395 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741397 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741401 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741405 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741408 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741411 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741413 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741416 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741419 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741422 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741424 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741427 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741430 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741433 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:51.743229 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.741435 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744290 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744308 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744313 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744319 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744323 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744328 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744340 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744345 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744349 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744358 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744364 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744369 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744374 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744378 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744383 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744388 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744394 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744398 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744409 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:51.744855 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744413 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744418 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744423 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744427 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744432 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744437 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744441 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744445 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744450 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744454 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744459 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744468 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744472 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744479 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744485 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744490 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744495 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744499 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744504 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744510 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:51.745485 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744515 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744521 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744525 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744535 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744540 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744545 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744549 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744554 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744558 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744563 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744568 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744574 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744579 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744584 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744588 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744593 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744602 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744606 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744610 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744615 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:51.746007 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744619 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744623 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744628 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744632 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744637 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744641 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744646 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744682 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744694 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744699 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744705 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744710 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744719 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744724 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744729 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744734 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744739 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744744 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744749 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:51.746527 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744753 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744763 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744768 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744772 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744779 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744784 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744789 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744794 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744801 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744806 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744812 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744817 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744822 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744827 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744837 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744842 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744847 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744851 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744857 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:51.747011 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744885 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.744930 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745508 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745516 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745521 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745526 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745530 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745533 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745536 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745539 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745542 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745545 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745548 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745551 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745554 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745556 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745559 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745562 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745564 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:51.747535 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745570 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745573 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745576 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745579 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745582 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745585 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745587 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745590 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745593 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745596 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745599 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745602 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745605 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745607 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745610 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745613 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745616 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745619 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745622 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745625 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:51.748013 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745628 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745631 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745634 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745636 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745639 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745642 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745647 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745650 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745653 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745656 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745659 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745662 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745667 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745670 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745673 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745676 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745679 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745682 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745684 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745687 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:51.748568 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745690 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745693 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745695 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745698 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745701 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745704 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745707 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745710 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745712 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745715 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745718 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745721 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745723 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745726 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745729 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745732 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745734 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745737 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745740 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:51.749114 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745742 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745745 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745749 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745751 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745754 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745758 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745761 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745764 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745766 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745769 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745772 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745774 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745777 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745780 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745782 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745785 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745788 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745790 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745793 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745796 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:51.749625 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745799 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745802 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.745806 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745890 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745898 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745903 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745908 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745913 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745916 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745920 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745925 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745928 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745931 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745935 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745939 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745942 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745945 2578 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745953 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745956 2578 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745959 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745963 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745967 2578 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745970 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:22:51.750130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745973 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745977 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745980 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745984 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745987 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745991 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745994 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.745998 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746001 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746004 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746008 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746011 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746021 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746024 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746027 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746030 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746033 2578 flags.go:64] FLAG: --enable-server="true" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746037 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746040 2578 flags.go:64] FLAG: --event-burst="100" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746044 2578 flags.go:64] FLAG: --event-qps="50" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746046 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746050 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746053 2578 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746057 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:22:51.750752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746060 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746063 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746068 2578 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746071 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746074 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746078 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746081 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746084 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746087 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746090 2578 flags.go:64] FLAG: --feature-gates="" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746094 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746097 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746100 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746104 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746107 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746110 2578 flags.go:64] FLAG: --help="false" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746113 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-159.ec2.internal" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746116 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746120 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746123 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746126 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746130 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746133 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:22:51.751387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746136 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746139 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746142 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746145 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746148 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746151 2578 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746154 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746157 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746160 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746163 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746166 2578 flags.go:64] FLAG: --lock-file="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746170 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746173 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746176 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746182 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746185 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746188 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746191 2578 flags.go:64] FLAG: --logging-format="text" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746194 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746198 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746201 2578 flags.go:64] FLAG: --manifest-url="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746204 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746208 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746212 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746216 2578 flags.go:64] FLAG: --max-pods="110" Jul 01 19:22:51.752022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746219 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746223 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746226 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746229 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746232 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746235 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746238 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746245 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746249 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746252 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746255 2578 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746258 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746264 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746267 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746270 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746273 2578 flags.go:64] FLAG: --port="10250" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746276 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746293 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cfc048816f995682" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746298 2578 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746301 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746305 2578 flags.go:64] FLAG: --register-node="true" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746308 2578 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746311 2578 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746315 2578 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:22:51.752679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746318 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746321 2578 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746325 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746328 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746331 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746334 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746337 2578 flags.go:64] FLAG: --runonce="false" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746341 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746344 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746347 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746350 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746353 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746356 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746360 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746363 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746366 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746369 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746372 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746375 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746379 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746382 2578 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746385 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746390 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746393 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746396 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:22:51.753300 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746401 2578 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746406 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746409 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746412 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746415 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746418 2578 flags.go:64] FLAG: --v="2" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746423 2578 flags.go:64] FLAG: --version="false" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746428 2578 flags.go:64] FLAG: --vmodule="" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746431 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.746438 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746557 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746563 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746566 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746570 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746573 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746576 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746579 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746582 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746585 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746588 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746591 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:51.753972 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746593 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746596 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746599 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746601 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746604 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746607 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746610 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746613 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746615 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746618 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746621 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746624 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746627 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746630 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746633 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746636 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746638 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746642 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746644 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746647 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:51.754538 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746651 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746654 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746657 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746660 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746663 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746666 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746668 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746671 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746674 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746677 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746679 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746683 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746685 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746688 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746691 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746694 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746696 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746699 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746702 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746705 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:51.755055 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746707 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746710 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746713 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746716 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746720 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746723 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746726 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746729 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746732 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746735 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746737 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746740 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746746 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746750 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746754 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746757 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746760 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746763 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746766 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746768 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:51.755600 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746771 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746774 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746776 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746779 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746782 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746785 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746787 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746790 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746793 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746795 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746798 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746802 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746806 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746809 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746812 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746815 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746820 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746823 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746825 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746828 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:51.756115 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746831 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746834 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746837 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746839 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746843 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746847 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746850 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.746852 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.748222 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.755427 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.755443 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.755463 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.755469 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755535 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755541 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:51.756644 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755545 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755548 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755551 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755554 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755557 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755560 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755562 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755565 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755568 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755571 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755575 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755579 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755582 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755585 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755589 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755592 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755594 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755598 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755601 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:51.757051 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755604 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755607 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755610 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755613 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755616 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755619 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755622 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755625 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755629 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755632 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755636 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755639 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755641 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755644 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755647 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755650 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755653 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755655 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755658 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755661 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:51.757559 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755664 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755667 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755669 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755672 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755674 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755677 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755680 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755684 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755687 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755690 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755693 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755696 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755700 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755703 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755705 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755708 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755711 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755714 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755716 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:51.758070 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755720 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755724 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755728 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755731 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755734 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755737 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755739 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755742 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755745 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755748 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755750 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755753 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755755 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755758 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755761 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755764 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755766 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755769 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755771 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755774 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:51.758707 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755777 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755779 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755782 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755785 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755787 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755790 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755793 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755797 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755799 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755802 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755805 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755808 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755810 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755813 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755816 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755819 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755822 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755825 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:51.759231 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755828 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.755833 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755947 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755952 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755955 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755958 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755963 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755966 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755969 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755972 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755976 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755980 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755983 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755986 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:51.759716 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755989 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755992 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755996 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.755999 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756002 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756005 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756008 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756011 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756013 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756016 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756019 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756022 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756024 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756027 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756031 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756033 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756037 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756039 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756042 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756045 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:51.760111 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756047 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756050 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756053 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756055 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756058 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756061 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756064 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756066 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756070 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756073 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756075 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756078 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756080 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756083 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756086 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756088 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756091 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756095 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756099 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756101 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:51.760638 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756104 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756107 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756110 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756112 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756115 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756118 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756121 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756124 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756127 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756130 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756133 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756136 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756139 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756142 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756144 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756147 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756150 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756153 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756155 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756158 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:51.761153 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756161 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756164 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756167 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756169 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756172 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756175 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756177 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756180 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756182 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756185 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756188 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756191 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756193 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756196 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756199 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756201 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756204 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756207 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756210 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:51.761682 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756213 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756217 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756221 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756224 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756227 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756230 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756234 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:51.756237 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.756242 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.756359 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.758570 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.760077 2578 server.go:1019] "Starting client certificate rotation" Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.760180 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:51.762164 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.760231 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:51.762744 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.762731 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:51.764003 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.763980 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:51.771587 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.771572 2578 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:22:51.773691 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.773678 2578 log.go:25] "Validated CRI v1 image API" Jul 01 19:22:51.774502 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.774486 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:22:51.777092 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.777068 2578 fs.go:135] Filesystem UUIDs: map[32b48e91-44bc-447f-b2f3-a6a654d60396:/dev/nvme0n1p4 59b05752-097b-4d33-a23e-e72204dba3d5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 01 19:22:51.777186 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.777092 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:22:51.782706 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.782586 2578 manager.go:216] Machine: {Timestamp:2026-07-01 19:22:51.782051204 +0000 UTC m=+0.361729957 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099476 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a741dc4e96f223cc143fadc7588e1 SystemUUID:ec2a741d-c4e9-6f22-3cc1-43fadc7588e1 BootID:bf725806-9872-42f5-af86-4b0c1b1fe89d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:c8:64:81:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:c8:64:81:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:75:c4:af:44:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:22:51.782706 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.782692 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:22:51.782848 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.782772 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:22:51.786201 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.786171 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:22:51.786399 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.786205 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:22:51.786982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.786969 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:22:51.787041 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.786987 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:22:51.787041 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.786998 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:51.787041 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.787015 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:51.787965 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.787953 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:22:51.791189 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.791173 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:51.791335 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.791324 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:22:51.792235 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792225 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:22:51.792269 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792241 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:22:51.792269 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792262 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:22:51.792349 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792274 2578 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:22:51.792349 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792300 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:22:51.792670 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792658 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:51.792709 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.792677 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:51.795234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.795216 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:22:51.797339 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.797324 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:22:51.797383 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.797358 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:22:51.798024 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798012 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:22:51.798061 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798029 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:22:51.798061 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798037 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:22:51.798061 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798047 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:22:51.798061 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798059 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:22:51.798169 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798066 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:22:51.798200 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798175 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:22:51.798200 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798181 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:22:51.798200 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798188 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:22:51.798200 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798194 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:22:51.798328 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798204 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:22:51.798328 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.798213 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:22:51.799089 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.799078 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:22:51.799089 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.799089 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:22:51.802433 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.802421 2578 server.go:1268] "Started kubelet" Jul 01 19:22:51.802608 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.802550 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:22:51.802681 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.802630 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:22:51.803331 ip-10-0-133-159 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:22:51.803448 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.803321 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:22:51.803856 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.803838 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:22:51.805501 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.805486 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:22:51.809385 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.809364 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:22:51.811513 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.811497 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:22:51.811568 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.811524 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:51.811947 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.811682 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:51.812347 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812328 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:22:51.812447 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812352 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:22:51.812447 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812327 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:22:51.812542 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812534 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:22:51.812596 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812544 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:22:51.812658 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812639 2578 factory.go:55] Registering systemd factory Jul 01 19:22:51.812716 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812661 2578 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:22:51.812911 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812895 2578 factory.go:153] Registering CRI-O factory Jul 01 19:22:51.812972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812916 2578 factory.go:223] Registration of the crio container factory successfully Jul 01 19:22:51.813016 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812970 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:22:51.813016 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.812998 2578 factory.go:103] Registering Raw factory Jul 01 19:22:51.813112 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.813018 2578 manager.go:1196] Started watching for new ooms in manager Jul 01 19:22:51.813657 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.813643 2578 manager.go:349] Starting recovery of all containers Jul 01 19:22:51.815853 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.815820 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:22:51.816097 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.816060 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:22:51.816224 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.816203 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:22:51.816722 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.816688 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:22:51.816826 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.816810 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:22:51.817452 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.816275 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-159.ec2.internal.18be40d1ae544098 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-159.ec2.internal,UID:ip-10-0-133-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-159.ec2.internal,},FirstTimestamp:2026-07-01 19:22:51.802394776 +0000 UTC m=+0.382073529,LastTimestamp:2026-07-01 19:22:51.802394776 +0000 UTC m=+0.382073529,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-159.ec2.internal,}" Jul 01 19:22:51.831094 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.831074 2578 manager.go:354] Recovery completed Jul 01 19:22:51.835866 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.835849 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.835973 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.835955 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:51.837830 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.837803 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.837935 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.837849 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.837935 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.837874 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.838534 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.838515 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:22:51.838534 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.838528 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.838534 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.838535 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:22:51.838716 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.838556 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:51.839278 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.839241 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.839478 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.839447 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.839530 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.839503 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.840338 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.840315 2578 policy_none.go:49] "None policy: Start" Jul 01 19:22:51.840338 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.840332 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:22:51.840441 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.840359 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:22:51.840656 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.840587 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-159.ec2.internal.18be40d1b070f15c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-159.ec2.internal,UID:ip-10-0-133-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-159.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-159.ec2.internal,},FirstTimestamp:2026-07-01 19:22:51.837829468 +0000 UTC m=+0.417508226,LastTimestamp:2026-07-01 19:22:51.837829468 +0000 UTC m=+0.417508226,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-159.ec2.internal,}" Jul 01 19:22:51.841649 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.841637 2578 policy_none.go:47] "Start" Jul 01 19:22:51.858973 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.858893 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-159.ec2.internal.18be40d1b0715dfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-159.ec2.internal,UID:ip-10-0-133-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-159.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-159.ec2.internal,},FirstTimestamp:2026-07-01 19:22:51.837857277 +0000 UTC m=+0.417536038,LastTimestamp:2026-07-01 19:22:51.837857277 +0000 UTC m=+0.417536038,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-159.ec2.internal,}" Jul 01 19:22:51.881846 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.881813 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.883245 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.883298 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.883351 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.883397 2578 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.883619 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-159.ec2.internal.18be40d1b071ba13 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-159.ec2.internal,UID:ip-10-0-133-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-159.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-159.ec2.internal,},FirstTimestamp:2026-07-01 19:22:51.837880851 +0000 UTC m=+0.417559606,LastTimestamp:2026-07-01 19:22:51.837880851 +0000 UTC m=+0.417559606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-159.ec2.internal,}" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.883922 2578 manager.go:337] "Starting Device Plugin manager" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.883964 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.883981 2578 server.go:87] "Starting device plugin registration server" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.884301 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.884314 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.884416 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.884504 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.884514 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.885593 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.885652 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:51.888541 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.886268 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pq5cm" Jul 01 19:22:51.900071 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.900051 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 01 19:22:51.900278 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.900215 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-159.ec2.internal.18be40d1b070f15c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-159.ec2.internal.18be40d1b070f15c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-159.ec2.internal,UID:ip-10-0-133-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-159.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-159.ec2.internal,},FirstTimestamp:2026-07-01 19:22:51.837829468 +0000 UTC m=+0.417508226,LastTimestamp:2026-07-01 19:22:51.839276828 +0000 UTC m=+0.418955582,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-159.ec2.internal,}" Jul 01 19:22:51.905768 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.905751 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pq5cm" Jul 01 19:22:51.984972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.984798 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.985106 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.984815 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal"] Jul 01 19:22:51.985106 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.985101 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.986329 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986310 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.986416 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986345 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.986416 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986361 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.986416 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986385 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-159.ec2.internal" Jul 01 19:22:51.986932 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986916 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.987004 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986940 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.987004 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.986950 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.988456 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.988444 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.988588 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.988561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:51.988649 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.988612 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.989152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.989137 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.989231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.989152 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.989231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.989164 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.989231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.989178 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.989231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.989193 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.989368 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.989180 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.990539 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.990522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" Jul 01 19:22:51.990602 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.990549 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:51.991148 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.991134 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:51.991202 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.991171 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:51.991202 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.991181 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:51.998954 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:51.998939 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-159.ec2.internal" Jul 01 19:22:51.999025 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:51.998960 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-159.ec2.internal\": node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.017084 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.017062 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-159.ec2.internal\" not found" node="ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.021754 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.021739 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-159.ec2.internal\" not found" node="ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.044618 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.044596 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.113299 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.113270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/033f9f8fede769a8ee76e9631924e442-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal\" (UID: \"033f9f8fede769a8ee76e9631924e442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.113433 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.113303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/033f9f8fede769a8ee76e9631924e442-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal\" (UID: \"033f9f8fede769a8ee76e9631924e442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.113433 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.113345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74636d215efc6b6c19362ef99095583b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-159.ec2.internal\" (UID: \"74636d215efc6b6c19362ef99095583b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.146821 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.146787 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.214617 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.214593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/033f9f8fede769a8ee76e9631924e442-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal\" (UID: \"033f9f8fede769a8ee76e9631924e442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.214717 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.214622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/033f9f8fede769a8ee76e9631924e442-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal\" (UID: \"033f9f8fede769a8ee76e9631924e442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.214717 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.214645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74636d215efc6b6c19362ef99095583b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-159.ec2.internal\" (UID: \"74636d215efc6b6c19362ef99095583b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.214717 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.214693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/033f9f8fede769a8ee76e9631924e442-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal\" (UID: \"033f9f8fede769a8ee76e9631924e442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.214717 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.214707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/74636d215efc6b6c19362ef99095583b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-159.ec2.internal\" (UID: \"74636d215efc6b6c19362ef99095583b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.214848 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.214695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/033f9f8fede769a8ee76e9631924e442-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal\" (UID: \"033f9f8fede769a8ee76e9631924e442\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.248375 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.248322 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.319967 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.319943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.326371 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.326341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.349088 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.349061 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.449873 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.449841 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.552748 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.552674 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.654771 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.654741 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.757857 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.757812 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-159.ec2.internal\" not found" Jul 01 19:22:52.759028 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.759011 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:22:52.789589 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.789544 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:52.793148 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.793128 2578 apiserver.go:52] "Watching apiserver" Jul 01 19:22:52.806068 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.806018 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:22:52.806394 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.806375 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-lrdbp","openshift-multus/network-metrics-daemon-q6djp","openshift-network-diagnostics/network-check-target-hpgfm","openshift-ovn-kubernetes/ovnkube-node-b2krn","openshift-cluster-node-tuning-operator/tuned-vw8vz","openshift-dns/node-resolver-j6s7s","openshift-multus/multus-4q4wn","openshift-network-operator/iptables-alerter-kk5xw","kube-system/global-pull-secret-syncer-flz5h","kube-system/konnectivity-agent-99mzn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd","openshift-image-registry/node-ca-t2jkw"] Jul 01 19:22:52.807934 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.807921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.809097 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.809075 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.810435 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.810417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.811593 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.811570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:52.811675 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.811644 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:22:52.811746 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.811681 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:52.812155 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.812139 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.812907 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.812890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:52.812970 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.812955 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:22:52.814216 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.814199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.815559 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.815543 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:52.816948 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.816932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.818199 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.818184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:52.819415 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:52.819506 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysconfig\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819506 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-lib-modules\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819506 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4c9s\" (UniqueName: \"kubernetes.io/projected/da799f11-5646-428f-ba1f-3aa666dcd781-kube-api-access-h4c9s\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819506 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.819460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:22:52.819506 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tf6w\" (UniqueName: \"kubernetes.io/projected/e48339a1-bd04-418d-97bf-ea2a62afa2f0-kube-api-access-2tf6w\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-var-lib-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-ovn\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-kubernetes\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-systemd\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-sys\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-host\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-system-cni-dir\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-os-release\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-kubelet\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-systemd-units\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.819701 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bff37e6-e84e-448c-a8c2-94654087ea64-ovn-node-metrics-cert\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-ovnkube-script-lib\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da799f11-5646-428f-ba1f-3aa666dcd781-etc-tuned\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e48339a1-bd04-418d-97bf-ea2a62afa2f0-serviceca\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-slash\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da799f11-5646-428f-ba1f-3aa666dcd781-tmp\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysctl-conf\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-run-ovn-kubernetes\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-ovnkube-config\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-env-overrides\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqg8j\" (UniqueName: \"kubernetes.io/projected/740bcff9-1be9-4693-bf44-b6cf23185fad-kube-api-access-hqg8j\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b6qd\" (UniqueName: \"kubernetes.io/projected/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-kube-api-access-6b6qd\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.819981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-cni-bin\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820109 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm98g\" (UniqueName: \"kubernetes.io/projected/4bff37e6-e84e-448c-a8c2-94654087ea64-kube-api-access-hm98g\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysctl-d\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-run\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-systemd\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-var-lib-kubelet\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e48339a1-bd04-418d-97bf-ea2a62afa2f0-host\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-etc-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-cni-netd\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-modprobe-d\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-cnibin\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-run-netns\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.820765 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-node-log\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.821351 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-log-socket\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.821351 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.820718 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:52.821965 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.821951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.822473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822446 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:22:52.822473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822446 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.822632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.822632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822535 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:22:52.822632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822545 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.822632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822454 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:22:52.822632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822555 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.822888 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822651 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.822948 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822931 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.822988 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.822949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4svtt\"" Jul 01 19:22:52.823070 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823056 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823699 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823717 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ck9fk\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pf5f9\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:22:52.823878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823859 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.824307 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.823889 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:22:52.824307 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.824084 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qv8kr\"" Jul 01 19:22:52.824307 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.824154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:22:52.824307 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.824165 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.824511 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.824369 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2kkkd\"" Jul 01 19:22:52.824511 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.824475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:22:52.824783 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.824766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:22:52.825346 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.825326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wsv4j\"" Jul 01 19:22:52.825429 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.825367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.825791 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.825764 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xqnst\"" Jul 01 19:22:52.825943 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.825925 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:22:52.826581 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.826407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pfddm\"" Jul 01 19:22:52.826581 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.826417 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:22:52.826838 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.826813 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.835940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.835915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:22:52.835940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.835937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:22:52.836097 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.836025 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:22:52.836097 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.836089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mdbs7\"" Jul 01 19:22:52.843895 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.843876 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal"] Jul 01 19:22:52.844029 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.844017 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:52.844089 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.844079 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" Jul 01 19:22:52.846986 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.846972 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:52.855349 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.855332 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:52.866207 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.866190 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal"] Jul 01 19:22:52.870280 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.870263 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:52.888377 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.888358 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-znpqh" Jul 01 19:22:52.911361 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.911322 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:17:52 +0000 UTC" deadline="2028-02-06 21:56:38.722778715 +0000 UTC" Jul 01 19:22:52.911361 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.911360 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14042h33m45.81142178s" Jul 01 19:22:52.912962 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.912945 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:22:52.921216 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-log-socket\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921281 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/193fbd87-c73c-4148-99a2-4abf6667a86f-hosts-file\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:52.921281 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j4qd\" (UniqueName: \"kubernetes.io/projected/193fbd87-c73c-4148-99a2-4abf6667a86f-kube-api-access-5j4qd\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:52.921281 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-system-cni-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.921281 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe0d367-517d-4389-b77a-1548a5db6f4f-cni-binary-copy\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-ovn\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-kubernetes\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-sys\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-kubernetes\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-host\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-log-socket\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-sys\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-ovn\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921451 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-host\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-os-release\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-cni-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-cni-multus\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-os-release\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-kubelet\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-kubelet\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-ovnkube-script-lib\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da799f11-5646-428f-ba1f-3aa666dcd781-etc-tuned\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-kubelet\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/193fbd87-c73c-4148-99a2-4abf6667a86f-tmp-dir\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:52.921775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-cnibin\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-k8s-cni-cncf-io\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-hostroot\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-conf-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysctl-conf\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-run-ovn-kubernetes\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-ovnkube-config\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqg8j\" (UniqueName: \"kubernetes.io/projected/740bcff9-1be9-4693-bf44-b6cf23185fad-kube-api-access-hqg8j\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-run-ovn-kubernetes\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.921994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c618b5a-b544-40a2-aa45-752234dcfe64-konnectivity-ca\") pod \"konnectivity-agent-99mzn\" (UID: \"0c618b5a-b544-40a2-aa45-752234dcfe64\") " pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-registration-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922025 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysctl-conf\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-cni-bin\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.922512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-run\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-systemd\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/995d5bb0-f698-4e66-a930-7744e3ee77b8-host-slash\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-daemon-config\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-run-systemd\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-etc-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-run\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-cnibin\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-etc-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-ovnkube-script-lib\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-cni-bin\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922456 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-cnibin\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysconfig\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.923430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-ovnkube-config\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-lib-modules\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9s\" (UniqueName: \"kubernetes.io/projected/da799f11-5646-428f-ba1f-3aa666dcd781-kube-api-access-h4c9s\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysconfig\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tf6w\" (UniqueName: \"kubernetes.io/projected/e48339a1-bd04-418d-97bf-ea2a62afa2f0-kube-api-access-2tf6w\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.922682 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c618b5a-b544-40a2-aa45-752234dcfe64-agent-certs\") pod \"konnectivity-agent-99mzn\" (UID: \"0c618b5a-b544-40a2-aa45-752234dcfe64\") " pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-lib-modules\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-socket-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.922842 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:22:53.422814787 +0000 UTC m=+2.002493544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-multus-certs\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-var-lib-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-systemd\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-system-cni-dir\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-var-lib-openvswitch\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.922994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.924254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-systemd\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/740bcff9-1be9-4693-bf44-b6cf23185fad-system-cni-dir\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b6qd\" (UniqueName: \"kubernetes.io/projected/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-kube-api-access-6b6qd\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-systemd-units\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bff37e6-e84e-448c-a8c2-94654087ea64-ovn-node-metrics-cert\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e48339a1-bd04-418d-97bf-ea2a62afa2f0-serviceca\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkhb6\" (UniqueName: \"kubernetes.io/projected/995d5bb0-f698-4e66-a930-7744e3ee77b8-kube-api-access-wkhb6\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79bfe935-9410-4436-b3ca-a12a8991782d-kubelet-config\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-slash\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da799f11-5646-428f-ba1f-3aa666dcd781-tmp\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-systemd-units\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-slash\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e48339a1-bd04-418d-97bf-ea2a62afa2f0-serviceca\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-device-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-env-overrides\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-os-release\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.925226 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-cni-bin\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.923981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm98g\" (UniqueName: \"kubernetes.io/projected/4bff37e6-e84e-448c-a8c2-94654087ea64-kube-api-access-hm98g\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysctl-d\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-sysctl-d\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79bfe935-9410-4436-b3ca-a12a8991782d-dbus\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924192 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bff37e6-e84e-448c-a8c2-94654087ea64-env-overrides\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-etc-kubernetes\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-var-lib-kubelet\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e48339a1-bd04-418d-97bf-ea2a62afa2f0-host\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/995d5bb0-f698-4e66-a930-7744e3ee77b8-iptables-alerter-script\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-var-lib-kubelet\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-sys-fs\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e48339a1-bd04-418d-97bf-ea2a62afa2f0-host\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-282v5\" (UniqueName: \"kubernetes.io/projected/6b67e025-2c36-4139-8c81-f752972ff6c1-kube-api-access-282v5\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:52.926161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bddv5\" (UniqueName: \"kubernetes.io/projected/ebe0d367-517d-4389-b77a-1548a5db6f4f-kube-api-access-bddv5\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-cni-netd\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-modprobe-d\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-cni-netd\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-socket-dir-parent\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-netns\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da799f11-5646-428f-ba1f-3aa666dcd781-etc-modprobe-d\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-run-netns\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-node-log\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.924955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-node-log\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.925015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bff37e6-e84e-448c-a8c2-94654087ea64-host-run-netns\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.925342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/740bcff9-1be9-4693-bf44-b6cf23185fad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.925945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da799f11-5646-428f-ba1f-3aa666dcd781-etc-tuned\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.926061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bff37e6-e84e-448c-a8c2-94654087ea64-ovn-node-metrics-cert\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.926711 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.926308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da799f11-5646-428f-ba1f-3aa666dcd781-tmp\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.932167 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.932148 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-znpqh" Jul 01 19:22:52.947442 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.947418 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:52.947442 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.947440 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:52.947692 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.947450 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:52.947692 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:52.947501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:53.447486938 +0000 UTC m=+2.027165676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:52.949928 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.949862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm98g\" (UniqueName: \"kubernetes.io/projected/4bff37e6-e84e-448c-a8c2-94654087ea64-kube-api-access-hm98g\") pod \"ovnkube-node-b2krn\" (UID: \"4bff37e6-e84e-448c-a8c2-94654087ea64\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:52.950161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.950106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tf6w\" (UniqueName: \"kubernetes.io/projected/e48339a1-bd04-418d-97bf-ea2a62afa2f0-kube-api-access-2tf6w\") pod \"node-ca-t2jkw\" (UID: \"e48339a1-bd04-418d-97bf-ea2a62afa2f0\") " pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:52.951052 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.951025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b6qd\" (UniqueName: \"kubernetes.io/projected/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-kube-api-access-6b6qd\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:52.951921 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.951888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4c9s\" (UniqueName: \"kubernetes.io/projected/da799f11-5646-428f-ba1f-3aa666dcd781-kube-api-access-h4c9s\") pod \"tuned-vw8vz\" (UID: \"da799f11-5646-428f-ba1f-3aa666dcd781\") " pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:52.952063 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:52.951992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqg8j\" (UniqueName: \"kubernetes.io/projected/740bcff9-1be9-4693-bf44-b6cf23185fad-kube-api-access-hqg8j\") pod \"multus-additional-cni-plugins-lrdbp\" (UID: \"740bcff9-1be9-4693-bf44-b6cf23185fad\") " pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:53.025805 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-cnibin\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.025805 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-k8s-cni-cncf-io\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-hostroot\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-conf-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c618b5a-b544-40a2-aa45-752234dcfe64-konnectivity-ca\") pod \"konnectivity-agent-99mzn\" (UID: \"0c618b5a-b544-40a2-aa45-752234dcfe64\") " pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-cnibin\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-hostroot\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025924 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-conf-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-k8s-cni-cncf-io\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026367 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.025938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-registration-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.026367 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/995d5bb0-f698-4e66-a930-7744e3ee77b8-host-slash\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.026464 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:53.026464 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-registration-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.026464 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-daemon-config\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026612 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.026519 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:53.026612 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c618b5a-b544-40a2-aa45-752234dcfe64-agent-certs\") pod \"konnectivity-agent-99mzn\" (UID: \"0c618b5a-b544-40a2-aa45-752234dcfe64\") " pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:53.026612 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/995d5bb0-f698-4e66-a930-7744e3ee77b8-host-slash\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.026612 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.026612 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.026595 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:53.526574586 +0000 UTC m=+2.106253346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:53.026858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.026858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-socket-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.026858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-multus-certs\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.026858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c618b5a-b544-40a2-aa45-752234dcfe64-konnectivity-ca\") pod \"konnectivity-agent-99mzn\" (UID: \"0c618b5a-b544-40a2-aa45-752234dcfe64\") " pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:53.026858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkhb6\" (UniqueName: \"kubernetes.io/projected/995d5bb0-f698-4e66-a930-7744e3ee77b8-kube-api-access-wkhb6\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.026858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79bfe935-9410-4436-b3ca-a12a8991782d-kubelet-config\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-multus-certs\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-device-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-socket-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-os-release\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-cni-bin\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-daemon-config\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.026998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-os-release\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79bfe935-9410-4436-b3ca-a12a8991782d-dbus\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-etc-kubernetes\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/995d5bb0-f698-4e66-a930-7744e3ee77b8-iptables-alerter-script\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-etc-kubernetes\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-cni-bin\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-sys-fs\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-282v5\" (UniqueName: \"kubernetes.io/projected/6b67e025-2c36-4139-8c81-f752972ff6c1-kube-api-access-282v5\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79bfe935-9410-4436-b3ca-a12a8991782d-dbus\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bddv5\" (UniqueName: \"kubernetes.io/projected/ebe0d367-517d-4389-b77a-1548a5db6f4f-kube-api-access-bddv5\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-socket-dir-parent\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027381 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-device-dir\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-netns\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/193fbd87-c73c-4148-99a2-4abf6667a86f-hosts-file\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-sys-fs\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j4qd\" (UniqueName: \"kubernetes.io/projected/193fbd87-c73c-4148-99a2-4abf6667a86f-kube-api-access-5j4qd\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-socket-dir-parent\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.027687 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-system-cni-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe0d367-517d-4389-b77a-1548a5db6f4f-cni-binary-copy\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-cni-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-cni-multus\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-kubelet\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-run-netns\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.027979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/193fbd87-c73c-4148-99a2-4abf6667a86f-tmp-dir\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/995d5bb0-f698-4e66-a930-7744e3ee77b8-iptables-alerter-script\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/193fbd87-c73c-4148-99a2-4abf6667a86f-hosts-file\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79bfe935-9410-4436-b3ca-a12a8991782d-kubelet-config\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028144 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-system-cni-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-cni-multus\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-host-var-lib-kubelet\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ebe0d367-517d-4389-b77a-1548a5db6f4f-multus-cni-dir\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.028344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b67e025-2c36-4139-8c81-f752972ff6c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.029042 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.028428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ebe0d367-517d-4389-b77a-1548a5db6f4f-cni-binary-copy\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.029396 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.029372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/193fbd87-c73c-4148-99a2-4abf6667a86f-tmp-dir\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.030167 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.029645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c618b5a-b544-40a2-aa45-752234dcfe64-agent-certs\") pod \"konnectivity-agent-99mzn\" (UID: \"0c618b5a-b544-40a2-aa45-752234dcfe64\") " pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:53.044043 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.044013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkhb6\" (UniqueName: \"kubernetes.io/projected/995d5bb0-f698-4e66-a930-7744e3ee77b8-kube-api-access-wkhb6\") pod \"iptables-alerter-kk5xw\" (UID: \"995d5bb0-f698-4e66-a930-7744e3ee77b8\") " pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.044925 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.044907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-282v5\" (UniqueName: \"kubernetes.io/projected/6b67e025-2c36-4139-8c81-f752972ff6c1-kube-api-access-282v5\") pod \"aws-ebs-csi-driver-node-n9cdd\" (UID: \"6b67e025-2c36-4139-8c81-f752972ff6c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.051165 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.051139 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033f9f8fede769a8ee76e9631924e442.slice/crio-5ccd1608949fd46652401ed17718df6503cf27cd310bc14be122dff24c391c57 WatchSource:0}: Error finding container 5ccd1608949fd46652401ed17718df6503cf27cd310bc14be122dff24c391c57: Status 404 returned error can't find the container with id 5ccd1608949fd46652401ed17718df6503cf27cd310bc14be122dff24c391c57 Jul 01 19:22:53.054869 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.054853 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:22:53.056781 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.056717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bddv5\" (UniqueName: \"kubernetes.io/projected/ebe0d367-517d-4389-b77a-1548a5db6f4f-kube-api-access-bddv5\") pod \"multus-4q4wn\" (UID: \"ebe0d367-517d-4389-b77a-1548a5db6f4f\") " pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.058633 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.058615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j4qd\" (UniqueName: \"kubernetes.io/projected/193fbd87-c73c-4148-99a2-4abf6667a86f-kube-api-access-5j4qd\") pod \"node-resolver-j6s7s\" (UID: \"193fbd87-c73c-4148-99a2-4abf6667a86f\") " pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.142306 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.142282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" Jul 01 19:22:53.149982 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.149961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda799f11_5646_428f_ba1f_3aa666dcd781.slice/crio-a5ff56bdca648e43b1d58ad1d41d5d1f7e194494d70394412caf2df2873b6e96 WatchSource:0}: Error finding container a5ff56bdca648e43b1d58ad1d41d5d1f7e194494d70394412caf2df2873b6e96: Status 404 returned error can't find the container with id a5ff56bdca648e43b1d58ad1d41d5d1f7e194494d70394412caf2df2873b6e96 Jul 01 19:22:53.157263 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.157246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t2jkw" Jul 01 19:22:53.165840 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.165819 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48339a1_bd04_418d_97bf_ea2a62afa2f0.slice/crio-9a4180fb68a5219628043fc2adfc8a4706788e1871a97935c3b8c6f77d796dd3 WatchSource:0}: Error finding container 9a4180fb68a5219628043fc2adfc8a4706788e1871a97935c3b8c6f77d796dd3: Status 404 returned error can't find the container with id 9a4180fb68a5219628043fc2adfc8a4706788e1871a97935c3b8c6f77d796dd3 Jul 01 19:22:53.176091 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.176076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" Jul 01 19:22:53.182621 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.182603 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740bcff9_1be9_4693_bf44_b6cf23185fad.slice/crio-497aef3d6f575df4748e34798dfe48d5af62e584b6b61d7a21ea8e15e51ba010 WatchSource:0}: Error finding container 497aef3d6f575df4748e34798dfe48d5af62e584b6b61d7a21ea8e15e51ba010: Status 404 returned error can't find the container with id 497aef3d6f575df4748e34798dfe48d5af62e584b6b61d7a21ea8e15e51ba010 Jul 01 19:22:53.196667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.196650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:22:53.200596 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.200578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6s7s" Jul 01 19:22:53.203378 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.203359 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bff37e6_e84e_448c_a8c2_94654087ea64.slice/crio-a28a93e4bdd3bf16706c02a74c269c18c59ffdd4247eb600eea41039b0286241 WatchSource:0}: Error finding container a28a93e4bdd3bf16706c02a74c269c18c59ffdd4247eb600eea41039b0286241: Status 404 returned error can't find the container with id a28a93e4bdd3bf16706c02a74c269c18c59ffdd4247eb600eea41039b0286241 Jul 01 19:22:53.208602 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.208576 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193fbd87_c73c_4148_99a2_4abf6667a86f.slice/crio-1e83c647fcbbb4e4562aa93e679adce3b5577a7cb9cda5f849fd238490ab7b1b WatchSource:0}: Error finding container 1e83c647fcbbb4e4562aa93e679adce3b5577a7cb9cda5f849fd238490ab7b1b: Status 404 returned error can't find the container with id 1e83c647fcbbb4e4562aa93e679adce3b5577a7cb9cda5f849fd238490ab7b1b Jul 01 19:22:53.216055 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.216038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4q4wn" Jul 01 19:22:53.223645 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.223626 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe0d367_517d_4389_b77a_1548a5db6f4f.slice/crio-5e9916d5d532eb6baabc3de696f3f557118300ae108d7b0d3627df14f380c35f WatchSource:0}: Error finding container 5e9916d5d532eb6baabc3de696f3f557118300ae108d7b0d3627df14f380c35f: Status 404 returned error can't find the container with id 5e9916d5d532eb6baabc3de696f3f557118300ae108d7b0d3627df14f380c35f Jul 01 19:22:53.236801 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.236787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kk5xw" Jul 01 19:22:53.243718 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.243697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995d5bb0_f698_4e66_a930_7744e3ee77b8.slice/crio-684c2769865f199ae53a9d491910cdfde123b23d8cc8266e53302d793a69dd25 WatchSource:0}: Error finding container 684c2769865f199ae53a9d491910cdfde123b23d8cc8266e53302d793a69dd25: Status 404 returned error can't find the container with id 684c2769865f199ae53a9d491910cdfde123b23d8cc8266e53302d793a69dd25 Jul 01 19:22:53.251474 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.251457 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:53.261353 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.261335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:22:53.267194 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.267171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" Jul 01 19:22:53.268353 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.268335 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c618b5a_b544_40a2_aa45_752234dcfe64.slice/crio-fc9219e7966cf601d4afe5ce101a66bb5161f64a42d5596c1f9f522e1f072851 WatchSource:0}: Error finding container fc9219e7966cf601d4afe5ce101a66bb5161f64a42d5596c1f9f522e1f072851: Status 404 returned error can't find the container with id fc9219e7966cf601d4afe5ce101a66bb5161f64a42d5596c1f9f522e1f072851 Jul 01 19:22:53.269353 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.269331 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:53.274384 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.274363 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b67e025_2c36_4139_8c81_f752972ff6c1.slice/crio-60bc115a1166affc5afb55877a76e2cd95039e1f78360670091b90d6f65fff09 WatchSource:0}: Error finding container 60bc115a1166affc5afb55877a76e2cd95039e1f78360670091b90d6f65fff09: Status 404 returned error can't find the container with id 60bc115a1166affc5afb55877a76e2cd95039e1f78360670091b90d6f65fff09 Jul 01 19:22:53.431018 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.430960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:53.431104 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.431074 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:53.431141 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.431133 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:22:54.431119326 +0000 UTC m=+3.010798069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:53.497488 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:22:53.497467 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74636d215efc6b6c19362ef99095583b.slice/crio-e83845049aeaf035662a605a529d8edf1f720477b1d38b20050b5db5c4890b04 WatchSource:0}: Error finding container e83845049aeaf035662a605a529d8edf1f720477b1d38b20050b5db5c4890b04: Status 404 returned error can't find the container with id e83845049aeaf035662a605a529d8edf1f720477b1d38b20050b5db5c4890b04 Jul 01 19:22:53.532120 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.532096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:53.532231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.532143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:53.532274 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.532259 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:53.532312 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.532277 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:53.532312 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.532292 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:53.532312 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.532305 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:53.532400 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.532321 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:54.532301584 +0000 UTC m=+3.111980337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:53.532400 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:53.532340 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:54.532328981 +0000 UTC m=+3.112007727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:53.893531 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.893471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" event={"ID":"74636d215efc6b6c19362ef99095583b","Type":"ContainerStarted","Data":"e83845049aeaf035662a605a529d8edf1f720477b1d38b20050b5db5c4890b04"} Jul 01 19:22:53.900369 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.900338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" event={"ID":"6b67e025-2c36-4139-8c81-f752972ff6c1","Type":"ContainerStarted","Data":"60bc115a1166affc5afb55877a76e2cd95039e1f78360670091b90d6f65fff09"} Jul 01 19:22:53.905656 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.905578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4q4wn" event={"ID":"ebe0d367-517d-4389-b77a-1548a5db6f4f","Type":"ContainerStarted","Data":"5e9916d5d532eb6baabc3de696f3f557118300ae108d7b0d3627df14f380c35f"} Jul 01 19:22:53.908017 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.907986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"a28a93e4bdd3bf16706c02a74c269c18c59ffdd4247eb600eea41039b0286241"} Jul 01 19:22:53.923387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.923255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerStarted","Data":"497aef3d6f575df4748e34798dfe48d5af62e584b6b61d7a21ea8e15e51ba010"} Jul 01 19:22:53.936394 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.936342 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:53 +0000 UTC" deadline="2028-01-26 22:12:53.034728663 +0000 UTC" Jul 01 19:22:53.936501 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.936396 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13778h49m59.098336618s" Jul 01 19:22:53.939881 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.939852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t2jkw" event={"ID":"e48339a1-bd04-418d-97bf-ea2a62afa2f0","Type":"ContainerStarted","Data":"9a4180fb68a5219628043fc2adfc8a4706788e1871a97935c3b8c6f77d796dd3"} Jul 01 19:22:53.945187 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.945161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" event={"ID":"da799f11-5646-428f-ba1f-3aa666dcd781","Type":"ContainerStarted","Data":"a5ff56bdca648e43b1d58ad1d41d5d1f7e194494d70394412caf2df2873b6e96"} Jul 01 19:22:53.954342 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.954313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" event={"ID":"033f9f8fede769a8ee76e9631924e442","Type":"ContainerStarted","Data":"5ccd1608949fd46652401ed17718df6503cf27cd310bc14be122dff24c391c57"} Jul 01 19:22:53.966093 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.966020 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-99mzn" event={"ID":"0c618b5a-b544-40a2-aa45-752234dcfe64","Type":"ContainerStarted","Data":"fc9219e7966cf601d4afe5ce101a66bb5161f64a42d5596c1f9f522e1f072851"} Jul 01 19:22:53.979768 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.979666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kk5xw" event={"ID":"995d5bb0-f698-4e66-a930-7744e3ee77b8","Type":"ContainerStarted","Data":"684c2769865f199ae53a9d491910cdfde123b23d8cc8266e53302d793a69dd25"} Jul 01 19:22:53.989065 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:53.988874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6s7s" event={"ID":"193fbd87-c73c-4148-99a2-4abf6667a86f","Type":"ContainerStarted","Data":"1e83c647fcbbb4e4562aa93e679adce3b5577a7cb9cda5f849fd238490ab7b1b"} Jul 01 19:22:54.439801 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.439763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:54.440004 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.439907 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:54.440004 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.439985 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:22:56.439962959 +0000 UTC m=+5.019641715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:54.540840 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.540807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:54.541026 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.540879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:54.541100 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.541027 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:54.541100 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.541046 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:54.541100 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.541060 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:54.541260 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.541118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:56.541097401 +0000 UTC m=+5.120776156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:54.541260 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.541195 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:54.541260 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.541231 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:56.54121924 +0000 UTC m=+5.120897979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:54.885302 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.884395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:54.885302 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.884556 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:22:54.885302 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.884973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:54.885302 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.885080 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:22:54.885302 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.885141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:54.885302 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:54.885240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:22:54.937390 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.937351 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:53 +0000 UTC" deadline="2028-04-17 10:58:25.332520142 +0000 UTC" Jul 01 19:22:54.937390 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:54.937388 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15735h35m30.39513649s" Jul 01 19:22:56.459800 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:56.459764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:56.460481 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.459915 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:56.460481 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.459987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:00.459966707 +0000 UTC m=+9.039645460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:56.560932 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:56.560886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:56.561107 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:56.560975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:56.561185 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.561145 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:56.561185 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.561165 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:56.561185 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.561178 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:56.561389 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.561268 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:00.561233395 +0000 UTC m=+9.140912140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:56.561698 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.561677 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:56.561797 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.561735 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:00.561719823 +0000 UTC m=+9.141398569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:56.883879 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:56.883759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:56.883879 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:56.883801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:56.884139 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.883942 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:22:56.884204 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.884160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:22:56.884204 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:56.883781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:56.884423 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:56.884352 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:22:58.884616 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:58.883794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:22:58.884616 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:58.883936 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:22:58.884616 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:58.884012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:22:58.884616 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:58.884081 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:22:58.884616 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:22:58.884134 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:22:58.884616 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:22:58.884215 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:00.498954 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:00.498901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:00.499442 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.499082 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:00.499442 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.499166 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:08.499143789 +0000 UTC m=+17.078822535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:00.599401 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:00.599346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:00.599581 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:00.599439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:00.599687 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.599623 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:00.599687 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.599637 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:00.599687 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.599656 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:00.599687 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.599668 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:00.599687 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.599685 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:08.59966662 +0000 UTC m=+17.179345372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:00.599989 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.599704 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:08.599693298 +0000 UTC m=+17.179372037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:00.884505 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:00.884410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:00.884505 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:00.884458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:00.884725 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.884538 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:00.884725 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:00.884424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:00.884725 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.884687 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:00.884872 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:00.884777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:02.884715 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:02.884390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:02.884715 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:02.884411 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:02.884715 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:02.884524 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:02.884715 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:02.884553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:02.884715 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:02.884651 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:02.885925 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:02.885883 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:04.884128 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:04.884095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:04.884128 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:04.884123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:04.884562 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:04.884226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:04.884562 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:04.884227 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:04.884562 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:04.884332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:04.884562 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:04.884399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:06.884131 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:06.884104 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:06.884610 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:06.884229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:06.884610 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:06.884244 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:06.884610 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:06.884238 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:06.884610 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:06.884337 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:06.884610 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:06.884405 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:08.559166 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:08.559128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:08.559572 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.559265 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:08.559572 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.559322 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:24.559308943 +0000 UTC m=+33.138987694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:08.660088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:08.660057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:08.660255 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:08.660111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:08.660255 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.660231 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:08.660255 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.660243 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:08.660411 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.660257 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:08.660411 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.660266 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:08.660411 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.660291 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:24.660276266 +0000 UTC m=+33.239955003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:08.660411 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.660312 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:24.660303063 +0000 UTC m=+33.239981804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:08.884656 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:08.884569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:08.884656 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:08.884594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:08.884656 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:08.884611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:08.884925 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.884695 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:08.884925 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.884814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:08.884925 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:08.884885 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:10.883766 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:10.883736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:10.883766 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:10.883758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:10.884276 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:10.883743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:10.884276 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:10.883852 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:10.884276 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:10.883934 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:10.884276 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:10.884023 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:12.883534 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:12.883493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:12.883993 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:12.883493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:12.883993 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:12.883622 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:12.883993 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:12.883696 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:12.883993 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:12.883720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:12.883993 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:12.883814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:14.883662 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:14.883538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:14.884172 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:14.883571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:14.884172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:14.883755 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:14.884172 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:14.883592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:14.884172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:14.883813 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:14.884172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:14.883897 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:15.031861 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.031685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t2jkw" event={"ID":"e48339a1-bd04-418d-97bf-ea2a62afa2f0","Type":"ContainerStarted","Data":"e67210e8bcd716e5fafa91cb58f7d565b7c152b15050ee53081576bff0508e0d"} Jul 01 19:23:15.033133 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.033109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" event={"ID":"da799f11-5646-428f-ba1f-3aa666dcd781","Type":"ContainerStarted","Data":"66b78a43a4b90a1b845e315393ed80c11cf0fe0bd2dd1e852602ce3db4165b92"} Jul 01 19:23:15.034574 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.034548 2578 generic.go:356] "Generic (PLEG): container finished" podID="033f9f8fede769a8ee76e9631924e442" containerID="8ce5103457cb0797b2fb7a6f8cade12085cbb0b10f3ec86acf5c9f4b5f35d3e5" exitCode=0 Jul 01 19:23:15.034674 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.034622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" event={"ID":"033f9f8fede769a8ee76e9631924e442","Type":"ContainerDied","Data":"8ce5103457cb0797b2fb7a6f8cade12085cbb0b10f3ec86acf5c9f4b5f35d3e5"} Jul 01 19:23:15.036094 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.036062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-99mzn" event={"ID":"0c618b5a-b544-40a2-aa45-752234dcfe64","Type":"ContainerStarted","Data":"088d8394b79c11e6f96a7af989e4debb3d44da89fee23ed934c61f9b49954212"} Jul 01 19:23:15.037735 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.037713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6s7s" event={"ID":"193fbd87-c73c-4148-99a2-4abf6667a86f","Type":"ContainerStarted","Data":"fb2a549b872545bb9ed6920ee7238b2fea6550e803ec37cb249e89642631ecad"} Jul 01 19:23:15.039288 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.039270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" event={"ID":"74636d215efc6b6c19362ef99095583b","Type":"ContainerStarted","Data":"bad0b191e411c2872811249b32d3c6bde1973748ec31c59e5257e020384dd77c"} Jul 01 19:23:15.040753 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.040726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" event={"ID":"6b67e025-2c36-4139-8c81-f752972ff6c1","Type":"ContainerStarted","Data":"af1c028e02b8ed856202854ec835d01b391c6f7017050f293342bfe5d9a8521e"} Jul 01 19:23:15.042075 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.042054 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4q4wn" event={"ID":"ebe0d367-517d-4389-b77a-1548a5db6f4f","Type":"ContainerStarted","Data":"ee6ca6a65fa520480419f5e973ab6fa1eb10c1addb6a2ad68b4f8c97985274a8"} Jul 01 19:23:15.044775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.044759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:23:15.045074 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045055 2578 generic.go:356] "Generic (PLEG): container finished" podID="4bff37e6-e84e-448c-a8c2-94654087ea64" containerID="4b1bcd6d2c07a7800412b0da7b86c3cde504aef70bf71b0ee96c7ba05c0be122" exitCode=1 Jul 01 19:23:15.045121 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"4ac1ac61c0fb3c184ab7d5f1153fb1f6f4f054e0ee6e1febe5815bd15e4ce290"} Jul 01 19:23:15.045157 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"699ec498fdf8d83d59a4b5d759b73ae2000ea2d0810792cda21e7c09624ce1d8"} Jul 01 19:23:15.045196 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"ac75c316163f44d8993ee11d759c30b30ac39cc158c48e9afe682cd509b29f42"} Jul 01 19:23:15.045261 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"73405e6f5a789d8c8795eca0f430270aff89c01687d9852fcf25909bdb5a5697"} Jul 01 19:23:15.045297 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerDied","Data":"4b1bcd6d2c07a7800412b0da7b86c3cde504aef70bf71b0ee96c7ba05c0be122"} Jul 01 19:23:15.045334 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.045305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"2ab5a7c5097a1883ea0c04f02d64c7445e782e643a877c424e07850bba2117c2"} Jul 01 19:23:15.046487 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.046468 2578 generic.go:356] "Generic (PLEG): container finished" podID="740bcff9-1be9-4693-bf44-b6cf23185fad" containerID="c96a22ea99b5ade82dfed92378078297f777607d3c4ff3f4aa10bcdaf9981d02" exitCode=0 Jul 01 19:23:15.046562 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.046496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerDied","Data":"c96a22ea99b5ade82dfed92378078297f777607d3c4ff3f4aa10bcdaf9981d02"} Jul 01 19:23:15.050192 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.050157 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t2jkw" podStartSLOduration=9.907489041 podStartE2EDuration="23.050146243s" totalImagesPullingTime="13.142657202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:15.049679712 +0000 UTC m=+23.629358472" watchObservedRunningTime="2026-07-01 19:23:15.050146243 +0000 UTC m=+23.629825002" Jul 01 19:23:15.087556 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.087458 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vw8vz" podStartSLOduration=1.9599934239999999 podStartE2EDuration="23.087439248s" totalImagesPullingTime="21.127445824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:15.086859163 +0000 UTC m=+23.666537925" watchObservedRunningTime="2026-07-01 19:23:15.087439248 +0000 UTC m=+23.667118009" Jul 01 19:23:15.101666 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.101559 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-159.ec2.internal" podStartSLOduration=22.101546497 podStartE2EDuration="22.101546497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:15.100694822 +0000 UTC m=+23.680373581" watchObservedRunningTime="2026-07-01 19:23:15.101546497 +0000 UTC m=+23.681225257" Jul 01 19:23:15.141282 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.141248 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j6s7s" podStartSLOduration=1.072307797 podStartE2EDuration="22.141237474s" totalImagesPullingTime="21.068929677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:15.140880844 +0000 UTC m=+23.720559604" watchObservedRunningTime="2026-07-01 19:23:15.141237474 +0000 UTC m=+23.720916234" Jul 01 19:23:15.158837 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.158800 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4q4wn" podStartSLOduration=1.050840617 podStartE2EDuration="22.158790066s" totalImagesPullingTime="21.107949449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:15.158352964 +0000 UTC m=+23.738031724" watchObservedRunningTime="2026-07-01 19:23:15.158790066 +0000 UTC m=+23.738468844" Jul 01 19:23:15.173599 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.173567 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-99mzn" podStartSLOduration=1.166249907 podStartE2EDuration="22.173551949s" totalImagesPullingTime="21.007302042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:15.173471253 +0000 UTC m=+23.753150011" watchObservedRunningTime="2026-07-01 19:23:15.173551949 +0000 UTC m=+23.753230707" Jul 01 19:23:15.310988 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.310947 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:15.391120 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:15.391068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:16.018284 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.018263 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:23:16.050560 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.050519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" event={"ID":"6b67e025-2c36-4139-8c81-f752972ff6c1","Type":"ContainerStarted","Data":"31d505646978eb1d7a3060c6ac2e4182ebd973fcf9685abca9618b12cedfc0eb"} Jul 01 19:23:16.052433 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.052411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" event={"ID":"033f9f8fede769a8ee76e9631924e442","Type":"ContainerStarted","Data":"8a7124e68d0d67076a926592fd27f1b5e7ab98594598fe4b16078e65898630b4"} Jul 01 19:23:16.053975 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.053939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kk5xw" event={"ID":"995d5bb0-f698-4e66-a930-7744e3ee77b8","Type":"ContainerStarted","Data":"bf7e58df23fea51992dc67328741121cb8d03dc94d0b0afbc5e04f402c9b7547"} Jul 01 19:23:16.070463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.070413 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-159.ec2.internal" podStartSLOduration=23.070399606 podStartE2EDuration="23.070399606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:16.070126116 +0000 UTC m=+24.649804877" watchObservedRunningTime="2026-07-01 19:23:16.070399606 +0000 UTC m=+24.650078365" Jul 01 19:23:16.089741 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.089701 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kk5xw" podStartSLOduration=2.057415324 podStartE2EDuration="23.089690068s" totalImagesPullingTime="21.032274744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:16.089126287 +0000 UTC m=+24.668805047" watchObservedRunningTime="2026-07-01 19:23:16.089690068 +0000 UTC m=+24.669368833" Jul 01 19:23:16.213540 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.213474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:16.279166 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.279145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:16.463501 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.463472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:23:16.464059 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.463981 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:23:16.750289 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.750263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:16.851565 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.851530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:16.883829 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.883803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:16.883984 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:16.883923 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:16.883984 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.883803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:16.884101 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:16.883994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:16.884101 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.883803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:16.884101 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:16.884046 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:16.899060 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.898975 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:23:16.018279852Z","UUID":"5d77cdad-5d3a-4128-8c89-58e4aea3fbf7","Handler":null,"Name":"","Endpoint":""} Jul 01 19:23:16.900638 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.900616 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:23:16.900745 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:16.900658 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:23:17.057058 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:17.057032 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:23:17.057450 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:17.057436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-99mzn" Jul 01 19:23:17.954889 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:17.954844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:18.061085 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:18.061053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" event={"ID":"6b67e025-2c36-4139-8c81-f752972ff6c1","Type":"ContainerStarted","Data":"ffa267c1f044504cde18b2c9402a0b9c6412630b61be920b5b5a371476a9e76f"} Jul 01 19:23:18.064640 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:18.064617 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:23:18.065079 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:18.065053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"ce64962a87dd172d42428075d943b1b7804df59246c03e2cf2268f5688866c4c"} Jul 01 19:23:18.884186 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:18.884155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:18.884377 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:18.884156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:18.884377 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:18.884295 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:18.884377 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:18.884162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:18.884377 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:18.884332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:18.884589 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:18.884408 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:19.547424 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:19.547253 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:20.072600 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.072548 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:23:20.072921 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.072897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"fdc1d9c9a5e8c60011a5eb7f956c7dad05aeeb3fd09c22fc193d1d7134aea7e3"} Jul 01 19:23:20.073305 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.073193 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:23:20.073305 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.073287 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:23:20.073448 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.073386 2578 scope.go:117] "RemoveContainer" containerID="4b1bcd6d2c07a7800412b0da7b86c3cde504aef70bf71b0ee96c7ba05c0be122" Jul 01 19:23:20.075007 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.074984 2578 generic.go:356] "Generic (PLEG): container finished" podID="740bcff9-1be9-4693-bf44-b6cf23185fad" containerID="a6440447871d670d94731d14f0b0b46b206a94c716136d121454796616e8362b" exitCode=0 Jul 01 19:23:20.075125 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.075032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerDied","Data":"a6440447871d670d94731d14f0b0b46b206a94c716136d121454796616e8362b"} Jul 01 19:23:20.088873 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.088854 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:23:20.107028 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.106995 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n9cdd" podStartSLOduration=3.620878099 podStartE2EDuration="27.106983728s" totalImagesPullingTime="23.486105629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:18.079115182 +0000 UTC m=+26.658793940" watchObservedRunningTime="2026-07-01 19:23:20.106983728 +0000 UTC m=+28.686662530" Jul 01 19:23:20.884468 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.884436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:20.885135 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.884507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:20.885135 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:20.884522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:20.885135 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:20.884611 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:20.885135 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:20.884743 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:20.885135 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:20.884844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:21.080857 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.080823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:23:21.081176 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.081155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" event={"ID":"4bff37e6-e84e-448c-a8c2-94654087ea64","Type":"ContainerStarted","Data":"16224c13d9232012ae233a67f927d82842abec3f21776d6594105e157fb875d7"} Jul 01 19:23:21.081347 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.081333 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:23:21.095254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.095234 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:23:21.116668 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.116248 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" podStartSLOduration=6.977263724 podStartE2EDuration="28.116230255s" totalImagesPullingTime="21.138966531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:21.113884146 +0000 UTC m=+29.693562906" watchObservedRunningTime="2026-07-01 19:23:21.116230255 +0000 UTC m=+29.695909014" Jul 01 19:23:21.515843 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.515677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:21.820246 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.820157 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-flz5h"] Jul 01 19:23:21.820457 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.820322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:21.820457 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:21.820434 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:21.822579 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.822554 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpgfm"] Jul 01 19:23:21.822691 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.822651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:21.822759 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:21.822738 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:21.835154 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.835133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6djp"] Jul 01 19:23:21.835282 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:21.835250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:21.835368 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:21.835347 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:22.084716 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:22.084648 2578 generic.go:356] "Generic (PLEG): container finished" podID="740bcff9-1be9-4693-bf44-b6cf23185fad" containerID="0535aa73897058193468943bd56c88a97f60394fd980ff48c36f02a5130d5077" exitCode=0 Jul 01 19:23:22.085136 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:22.084746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerDied","Data":"0535aa73897058193468943bd56c88a97f60394fd980ff48c36f02a5130d5077"} Jul 01 19:23:23.884597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:23.884565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:23.884597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:23.884586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:23.885049 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:23.884565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:23.885049 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:23.884689 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:23.885049 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:23.884740 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:23.885049 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:23.884803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:24.090037 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:24.089973 2578 generic.go:356] "Generic (PLEG): container finished" podID="740bcff9-1be9-4693-bf44-b6cf23185fad" containerID="dd986afb84de0311f1467e734dfb1fc5a1bf57aec95da3dfa6915a5f57fb0605" exitCode=0 Jul 01 19:23:24.090037 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:24.090025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerDied","Data":"dd986afb84de0311f1467e734dfb1fc5a1bf57aec95da3dfa6915a5f57fb0605"} Jul 01 19:23:24.580991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:24.580966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:24.581138 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.581079 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:24.581138 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.581122 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:56.581109864 +0000 UTC m=+65.160788600 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:24.681279 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:24.681246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:24.681437 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:24.681301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:24.681437 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.681392 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:24.681437 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.681430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret podName:79bfe935-9410-4436-b3ca-a12a8991782d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:56.681418284 +0000 UTC m=+65.261097021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret") pod "global-pull-secret-syncer-flz5h" (UID: "79bfe935-9410-4436-b3ca-a12a8991782d") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:24.681602 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.681392 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:24.681602 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.681486 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:24.681602 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.681498 2578 projected.go:196] Error preparing data for projected volume kube-api-access-wttzf for pod openshift-network-diagnostics/network-check-target-hpgfm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:24.681602 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:24.681538 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf podName:5f73ae23-bda9-4162-9550-d034f467c6e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:56.681527207 +0000 UTC m=+65.261205947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wttzf" (UniqueName: "kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf") pod "network-check-target-hpgfm" (UID: "5f73ae23-bda9-4162-9550-d034f467c6e3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:25.883689 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:25.883659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:25.883689 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:25.883688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:25.884130 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:25.883796 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6djp" podUID="7a29044a-b5a6-4b29-8cd8-58fab4b0b59b" Jul 01 19:23:25.884130 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:25.883872 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpgfm" podUID="5f73ae23-bda9-4162-9550-d034f467c6e3" Jul 01 19:23:25.884130 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:25.883909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:25.884130 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:25.884024 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-flz5h" podUID="79bfe935-9410-4436-b3ca-a12a8991782d" Jul 01 19:23:27.186671 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.186599 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-159.ec2.internal" event="NodeReady" Jul 01 19:23:27.187090 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.186731 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:23:27.246153 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.246128 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4whx"] Jul 01 19:23:27.276276 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.276251 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rk98g"] Jul 01 19:23:27.276418 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.276374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.279328 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.279089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b6mr\"" Jul 01 19:23:27.279630 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.279604 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:23:27.279849 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.279836 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:23:27.290299 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.290277 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4whx"] Jul 01 19:23:27.290402 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.290315 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rk98g"] Jul 01 19:23:27.290402 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.290380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.293297 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.293275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:23:27.293525 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.293473 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:23:27.293604 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.293575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:23:27.293659 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.293652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-krlqs\"" Jul 01 19:23:27.391024 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.390990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:27.403956 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.403923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft72z\" (UniqueName: \"kubernetes.io/projected/99d44382-6b98-4042-8601-6ebb97326b2b-kube-api-access-ft72z\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.404075 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.403963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frvtv\" (UniqueName: \"kubernetes.io/projected/30ca6c63-8e2e-4c35-a8b1-e1a67a42769a-kube-api-access-frvtv\") pod \"ingress-canary-rk98g\" (UID: \"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a\") " pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.404075 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.403988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30ca6c63-8e2e-4c35-a8b1-e1a67a42769a-cert\") pod \"ingress-canary-rk98g\" (UID: \"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a\") " pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.404191 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.404079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.404191 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.404107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d44382-6b98-4042-8601-6ebb97326b2b-tmp-dir\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.404191 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.404163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d44382-6b98-4042-8601-6ebb97326b2b-config-volume\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.446697 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.446640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:27.505147 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft72z\" (UniqueName: \"kubernetes.io/projected/99d44382-6b98-4042-8601-6ebb97326b2b-kube-api-access-ft72z\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.505295 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frvtv\" (UniqueName: \"kubernetes.io/projected/30ca6c63-8e2e-4c35-a8b1-e1a67a42769a-kube-api-access-frvtv\") pod \"ingress-canary-rk98g\" (UID: \"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a\") " pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.505295 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30ca6c63-8e2e-4c35-a8b1-e1a67a42769a-cert\") pod \"ingress-canary-rk98g\" (UID: \"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a\") " pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.505295 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.505295 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d44382-6b98-4042-8601-6ebb97326b2b-tmp-dir\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.505490 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d44382-6b98-4042-8601-6ebb97326b2b-config-volume\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.505490 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:27.505437 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:27.505583 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:27.505496 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:28.005477472 +0000 UTC m=+36.585156235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:27.505918 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.505896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d44382-6b98-4042-8601-6ebb97326b2b-tmp-dir\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.506199 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.506175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d44382-6b98-4042-8601-6ebb97326b2b-config-volume\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.509929 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.509910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30ca6c63-8e2e-4c35-a8b1-e1a67a42769a-cert\") pod \"ingress-canary-rk98g\" (UID: \"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a\") " pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.514458 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.514426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft72z\" (UniqueName: \"kubernetes.io/projected/99d44382-6b98-4042-8601-6ebb97326b2b-kube-api-access-ft72z\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:27.514835 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.514811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frvtv\" (UniqueName: \"kubernetes.io/projected/30ca6c63-8e2e-4c35-a8b1-e1a67a42769a-kube-api-access-frvtv\") pod \"ingress-canary-rk98g\" (UID: \"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a\") " pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.598859 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.598833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rk98g" Jul 01 19:23:27.629969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.629943 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:27.884304 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.884273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:27.884481 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.884282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:27.884481 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.884284 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:27.887883 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.887777 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqcw7\"" Jul 01 19:23:27.887883 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.887845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:27.888096 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.887846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:27.888861 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.888831 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tgvrs\"" Jul 01 19:23:27.888861 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.888834 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:27.888861 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:27.888861 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:28.008932 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:28.008901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:28.009093 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:28.009052 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:28.009161 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:28.009110 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:29.009094597 +0000 UTC m=+37.588773334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:28.408068 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:28.408040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rk98g"] Jul 01 19:23:28.486036 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:23:28.486000 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ca6c63_8e2e_4c35_a8b1_e1a67a42769a.slice/crio-406f420480f23f75c22cc689c87f0f3f58ae8d20fdb92c5f572ae0dc0d5561d0 WatchSource:0}: Error finding container 406f420480f23f75c22cc689c87f0f3f58ae8d20fdb92c5f572ae0dc0d5561d0: Status 404 returned error can't find the container with id 406f420480f23f75c22cc689c87f0f3f58ae8d20fdb92c5f572ae0dc0d5561d0 Jul 01 19:23:29.017123 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:29.016903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:29.017311 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:29.017070 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:29.017311 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:29.017235 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:31.017199228 +0000 UTC m=+39.596877968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:29.104519 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:29.104486 2578 generic.go:356] "Generic (PLEG): container finished" podID="740bcff9-1be9-4693-bf44-b6cf23185fad" containerID="9c82016de6ec013922d9454dd9482b51ae6baf2bab1e8409d22646188e6efeee" exitCode=0 Jul 01 19:23:29.104654 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:29.104575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerDied","Data":"9c82016de6ec013922d9454dd9482b51ae6baf2bab1e8409d22646188e6efeee"} Jul 01 19:23:29.105830 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:29.105809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rk98g" event={"ID":"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a","Type":"ContainerStarted","Data":"406f420480f23f75c22cc689c87f0f3f58ae8d20fdb92c5f572ae0dc0d5561d0"} Jul 01 19:23:30.112384 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:30.112346 2578 generic.go:356] "Generic (PLEG): container finished" podID="740bcff9-1be9-4693-bf44-b6cf23185fad" containerID="35ad0ab37e7152ce2b062f4e648af4024441ad3a3c3af2bb36714a3b24b20ba1" exitCode=0 Jul 01 19:23:30.112824 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:30.112408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerDied","Data":"35ad0ab37e7152ce2b062f4e648af4024441ad3a3c3af2bb36714a3b24b20ba1"} Jul 01 19:23:31.033885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.033857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:31.034040 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:31.034018 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:31.034093 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:31.034083 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:35.034065303 +0000 UTC m=+43.613744049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:31.116275 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.116238 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rk98g" event={"ID":"30ca6c63-8e2e-4c35-a8b1-e1a67a42769a","Type":"ContainerStarted","Data":"656c42c15367e792080714ebb5279465c5e726865fb454daf98d557b9ad6face"} Jul 01 19:23:31.119391 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.119370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" event={"ID":"740bcff9-1be9-4693-bf44-b6cf23185fad","Type":"ContainerStarted","Data":"9298039aba36290608c211dcfecddd6b152a189b667cae9c60590a93fde9298f"} Jul 01 19:23:31.133937 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.133903 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rk98g" podStartSLOduration=1.993208041 podStartE2EDuration="4.133889671s" totalImagesPullingTime="2.14068163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:31.133345053 +0000 UTC m=+39.713023813" watchObservedRunningTime="2026-07-01 19:23:31.133889671 +0000 UTC m=+39.713568408" Jul 01 19:23:31.212721 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.210677 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lrdbp" podStartSLOduration=5.49057083 podStartE2EDuration="38.210655431s" totalImagesPullingTime="32.720084601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:31.210170028 +0000 UTC m=+39.789848787" watchObservedRunningTime="2026-07-01 19:23:31.210655431 +0000 UTC m=+39.790334192" Jul 01 19:23:31.357834 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.357771 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:31.457574 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.457545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:31.516425 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.516396 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:31.892270 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:31.892240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:34.663389 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:34.663358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:34.727856 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:34.727831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:35.060012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:35.059980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:35.060172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:35.060099 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:35.060172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:35.060150 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.060137096 +0000 UTC m=+51.639815833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:36.777631 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:36.777597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:36.840766 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:36.840743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:43.112406 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:43.112372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:43.112826 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:43.112524 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:43.112826 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:43.112585 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:59.112570648 +0000 UTC m=+67.692249390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:53.096618 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:53.096594 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2krn" Jul 01 19:23:53.262059 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:53.262025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:53.332647 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:53.332624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.679501 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.679467 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4n62t"] Jul 01 19:23:55.682333 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.682313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.684363 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.684343 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4"] Jul 01 19:23:55.685982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.685966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:55.686678 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.686660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 19:23:55.686786 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.686679 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:55.687643 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.687619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kvpdj\"" Jul 01 19:23:55.688706 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.688689 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9d46b8597-b2hgl"] Jul 01 19:23:55.689978 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.689571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:55.690345 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.690328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.690423 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.690355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 19:23:55.690423 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.690406 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:55.690529 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.690452 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rg569\"" Jul 01 19:23:55.690841 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.690824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:55.693835 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:55.693814 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-133-159.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-159.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" Jul 01 19:23:55.694152 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:55.694137 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-133-159.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-159.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" Jul 01 19:23:55.698546 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafb77da-2ae1-4563-9e7a-b08997f67e2a-config\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.698633 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafb77da-2ae1-4563-9e7a-b08997f67e2a-trusted-ca\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.698633 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-stats-auth\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.698633 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafb77da-2ae1-4563-9e7a-b08997f67e2a-serving-cert\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.698633 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vprzg\" (UniqueName: \"kubernetes.io/projected/0256c3cf-3b37-4daf-8bc0-2d56c2964def-kube-api-access-vprzg\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.698762 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-default-certificate\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.698802 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:55.698836 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9fjx\" (UniqueName: \"kubernetes.io/projected/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-kube-api-access-n9fjx\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:55.698868 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdrdn\" (UniqueName: \"kubernetes.io/projected/bafb77da-2ae1-4563-9e7a-b08997f67e2a-kube-api-access-fdrdn\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.698900 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.698947 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.698933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.699483 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.699470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 19:23:55.707820 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.707805 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:23:55.712876 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.712859 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4n62t"] Jul 01 19:23:55.744639 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.744614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 19:23:55.744892 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.744872 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:23:55.744892 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.744888 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 19:23:55.745047 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.744927 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rlnm6\"" Jul 01 19:23:55.745047 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:55.744999 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-133-159.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-159.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" Jul 01 19:23:55.745490 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.745471 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4"] Jul 01 19:23:55.770488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.770468 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9d46b8597-b2hgl"] Jul 01 19:23:55.799288 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-default-certificate\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.799400 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:55.799400 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9fjx\" (UniqueName: \"kubernetes.io/projected/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-kube-api-access-n9fjx\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:55.799400 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdrdn\" (UniqueName: \"kubernetes.io/projected/bafb77da-2ae1-4563-9e7a-b08997f67e2a-kube-api-access-fdrdn\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.799560 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:55.799406 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:55.799560 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.799560 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:55.799479 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls podName:1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:56.29945955 +0000 UTC m=+64.879138307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-zc8z4" (UID: "1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b") : secret "samples-operator-tls" not found Jul 01 19:23:55.799560 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.799763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafb77da-2ae1-4563-9e7a-b08997f67e2a-config\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.799763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafb77da-2ae1-4563-9e7a-b08997f67e2a-trusted-ca\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.799763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-stats-auth\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.799763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafb77da-2ae1-4563-9e7a-b08997f67e2a-serving-cert\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.799763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.799701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vprzg\" (UniqueName: \"kubernetes.io/projected/0256c3cf-3b37-4daf-8bc0-2d56c2964def-kube-api-access-vprzg\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.800341 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.800313 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafb77da-2ae1-4563-9e7a-b08997f67e2a-config\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.800474 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.800445 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafb77da-2ae1-4563-9e7a-b08997f67e2a-trusted-ca\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.803052 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.803035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafb77da-2ae1-4563-9e7a-b08997f67e2a-serving-cert\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.803159 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.803140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-stats-auth\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.824022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.823995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdrdn\" (UniqueName: \"kubernetes.io/projected/bafb77da-2ae1-4563-9e7a-b08997f67e2a-kube-api-access-fdrdn\") pod \"console-operator-7fdbdf9c99-4n62t\" (UID: \"bafb77da-2ae1-4563-9e7a-b08997f67e2a\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:55.824114 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.824018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vprzg\" (UniqueName: \"kubernetes.io/projected/0256c3cf-3b37-4daf-8bc0-2d56c2964def-kube-api-access-vprzg\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:55.824688 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.824673 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9fjx\" (UniqueName: \"kubernetes.io/projected/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-kube-api-access-n9fjx\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:55.974470 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.974442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:55.993676 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:55.993658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:23:56.073058 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.073033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:56.113877 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.113852 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4n62t"] Jul 01 19:23:56.116918 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:23:56.116896 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafb77da_2ae1_4563_9e7a_b08997f67e2a.slice/crio-a76e638ac0854249843a342b8285b0655996e8a3b0e64b9475c4d6366e082b74 WatchSource:0}: Error finding container a76e638ac0854249843a342b8285b0655996e8a3b0e64b9475c4d6366e082b74: Status 404 returned error can't find the container with id a76e638ac0854249843a342b8285b0655996e8a3b0e64b9475c4d6366e082b74 Jul 01 19:23:56.180496 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.180468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" event={"ID":"bafb77da-2ae1-4563-9e7a-b08997f67e2a","Type":"ContainerStarted","Data":"a76e638ac0854249843a342b8285b0655996e8a3b0e64b9475c4d6366e082b74"} Jul 01 19:23:56.304245 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.304161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:56.304345 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.304301 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:56.304383 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.304361 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls podName:1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.304344809 +0000 UTC m=+65.884023550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-zc8z4" (UID: "1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b") : secret "samples-operator-tls" not found Jul 01 19:23:56.603321 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.603249 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 19:23:56.606788 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.606768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:23:56.609549 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.609530 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:56.611689 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.611663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-default-certificate\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:56.617817 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.617803 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:23:56.617873 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.617864 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs podName:7a29044a-b5a6-4b29-8cd8-58fab4b0b59b nodeName:}" failed. No retries permitted until 2026-07-01 19:25:00.617846231 +0000 UTC m=+129.197524982 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs") pod "network-metrics-daemon-q6djp" (UID: "7a29044a-b5a6-4b29-8cd8-58fab4b0b59b") : secret "metrics-daemon-secret" not found Jul 01 19:23:56.707844 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.707814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:56.708285 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.707883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:56.710940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.710916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:56.711043 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.710979 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:56.720693 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.720665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79bfe935-9410-4436-b3ca-a12a8991782d-original-pull-secret\") pod \"global-pull-secret-syncer-flz5h\" (UID: \"79bfe935-9410-4436-b3ca-a12a8991782d\") " pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:56.721179 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.721158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:56.730646 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.730618 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wttzf\" (UniqueName: \"kubernetes.io/projected/5f73ae23-bda9-4162-9550-d034f467c6e3-kube-api-access-wttzf\") pod \"network-check-target-hpgfm\" (UID: \"5f73ae23-bda9-4162-9550-d034f467c6e3\") " pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:56.799865 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.799844 2578 configmap.go:193] Couldn't get configMap openshift-ingress/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Jul 01 19:23:56.799865 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.799855 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: failed to sync secret cache: timed out waiting for the condition Jul 01 19:23:56.800033 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.799910 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.299895624 +0000 UTC m=+65.879574361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : failed to sync configmap cache: timed out waiting for the condition Jul 01 19:23:56.800033 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:56.799925 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.299917402 +0000 UTC m=+65.879596139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : failed to sync secret cache: timed out waiting for the condition Jul 01 19:23:56.995775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:56.995749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-flz5h" Jul 01 19:23:57.018743 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.018550 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tgvrs\"" Jul 01 19:23:57.025531 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.025343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:23:57.146657 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.146630 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-flz5h"] Jul 01 19:23:57.150169 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:23:57.149903 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bfe935_9410_4436_b3ca_a12a8991782d.slice/crio-c9489217d53c71da98af329951826ae8b6ae9c2d2f8903dc153debf5cdf2465e WatchSource:0}: Error finding container c9489217d53c71da98af329951826ae8b6ae9c2d2f8903dc153debf5cdf2465e: Status 404 returned error can't find the container with id c9489217d53c71da98af329951826ae8b6ae9c2d2f8903dc153debf5cdf2465e Jul 01 19:23:57.164535 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.164508 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpgfm"] Jul 01 19:23:57.168322 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:23:57.168297 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f73ae23_bda9_4162_9550_d034f467c6e3.slice/crio-d8b453dcec771a92d1ff8b731555c719b7bb41386af53d595d37c0f9b419d2e6 WatchSource:0}: Error finding container d8b453dcec771a92d1ff8b731555c719b7bb41386af53d595d37c0f9b419d2e6: Status 404 returned error can't find the container with id d8b453dcec771a92d1ff8b731555c719b7bb41386af53d595d37c0f9b419d2e6 Jul 01 19:23:57.184756 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.184726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpgfm" event={"ID":"5f73ae23-bda9-4162-9550-d034f467c6e3","Type":"ContainerStarted","Data":"d8b453dcec771a92d1ff8b731555c719b7bb41386af53d595d37c0f9b419d2e6"} Jul 01 19:23:57.185905 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.185879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-flz5h" event={"ID":"79bfe935-9410-4436-b3ca-a12a8991782d","Type":"ContainerStarted","Data":"c9489217d53c71da98af329951826ae8b6ae9c2d2f8903dc153debf5cdf2465e"} Jul 01 19:23:57.196784 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.196763 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 19:23:57.313178 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.313099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:57.313328 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.313202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:57.313328 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.313252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:57.313448 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:57.313334 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:57.313448 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:57.313379 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:23:58.313362782 +0000 UTC m=+66.893041522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:57.313448 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:57.313397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls podName:1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b nodeName:}" failed. No retries permitted until 2026-07-01 19:23:59.31338887 +0000 UTC m=+67.893067607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-zc8z4" (UID: "1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b") : secret "samples-operator-tls" not found Jul 01 19:23:57.327686 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.327666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 19:23:57.333769 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:57.333748 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:57.333871 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:57.333809 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:23:58.333791844 +0000 UTC m=+66.913470594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : secret "router-metrics-certs-default" not found Jul 01 19:23:57.674745 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.674639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:57.757258 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:57.757163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:58.322159 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:58.322130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:58.322420 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:58.322398 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:00.322377075 +0000 UTC m=+68.902055823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : configmap references non-existent config key: service-ca.crt Jul 01 19:23:58.422873 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:58.422836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:23:58.423088 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:58.422959 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:23:58.423088 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:58.423022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:00.423003204 +0000 UTC m=+69.002681941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : secret "router-metrics-certs-default" not found Jul 01 19:23:59.128544 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.128506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:23:59.129009 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.128659 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:59.129009 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.128731 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls podName:99d44382-6b98-4042-8601-6ebb97326b2b nodeName:}" failed. No retries permitted until 2026-07-01 19:24:31.128711502 +0000 UTC m=+99.708390262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls") pod "dns-default-n4whx" (UID: "99d44382-6b98-4042-8601-6ebb97326b2b") : secret "dns-default-metrics-tls" not found Jul 01 19:23:59.197184 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.197152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/0.log" Jul 01 19:23:59.197340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.197198 2578 generic.go:356] "Generic (PLEG): container finished" podID="bafb77da-2ae1-4563-9e7a-b08997f67e2a" containerID="b5dd6a730d72614c124ea8accf611f2aee682688ee2acc58d7f5bf0ab992d5ed" exitCode=255 Jul 01 19:23:59.197340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.197243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" event={"ID":"bafb77da-2ae1-4563-9e7a-b08997f67e2a","Type":"ContainerDied","Data":"b5dd6a730d72614c124ea8accf611f2aee682688ee2acc58d7f5bf0ab992d5ed"} Jul 01 19:23:59.197493 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.197481 2578 scope.go:117] "RemoveContainer" containerID="b5dd6a730d72614c124ea8accf611f2aee682688ee2acc58d7f5bf0ab992d5ed" Jul 01 19:23:59.330315 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.330195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:23:59.330485 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.330342 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:59.330485 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.330439 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls podName:1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.330416725 +0000 UTC m=+71.910095474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-zc8z4" (UID: "1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b") : secret "samples-operator-tls" not found Jul 01 19:23:59.489470 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.489436 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-srhss"] Jul 01 19:23:59.493155 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.493133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.496407 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.496141 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fr8gc\"" Jul 01 19:23:59.496407 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.496315 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:23:59.496407 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.496399 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:23:59.496668 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.496404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:23:59.496668 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.496639 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:23:59.518283 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.518256 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-srhss"] Jul 01 19:23:59.531340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.531313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-data-volume\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.531473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.531356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdvh\" (UniqueName: \"kubernetes.io/projected/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-api-access-lfdvh\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.531473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.531440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-crio-socket\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.531583 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.531491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.531583 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.531542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.533736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.533700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:23:59.632763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.632730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-data-volume\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.632940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.632772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdvh\" (UniqueName: \"kubernetes.io/projected/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-api-access-lfdvh\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.632940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.632832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-crio-socket\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.632940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.632884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.632940 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.632935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.633145 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.633035 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:59.633145 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.633106 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:00.13308734 +0000 UTC m=+68.712766092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : configmap "kube-rbac-proxy" not found Jul 01 19:23:59.633493 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.633276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-crio-socket\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.633493 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.633388 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:59.633493 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:23:59.633468 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:00.133448202 +0000 UTC m=+68.713126943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:59.633679 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.633605 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-data-volume\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:23:59.658656 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:23:59.658622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdvh\" (UniqueName: \"kubernetes.io/projected/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-api-access-lfdvh\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:00.136668 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:00.136628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:00.137147 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:00.136706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:00.137147 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.136745 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:00.137147 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.136799 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:00.137147 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.136830 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:01.136809689 +0000 UTC m=+69.716488737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:00.137147 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.136872 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:01.136854704 +0000 UTC m=+69.716533442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : configmap "kube-rbac-proxy" not found Jul 01 19:24:00.338003 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:00.337957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:00.338172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.338113 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:04.33809675 +0000 UTC m=+72.917775490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : configmap references non-existent config key: service-ca.crt Jul 01 19:24:00.439399 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:00.439312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:00.439549 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.439491 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:24:00.439607 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:00.439571 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:04.439549966 +0000 UTC m=+73.019228719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : secret "router-metrics-certs-default" not found Jul 01 19:24:01.144503 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:01.144469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:01.144892 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:01.144529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:01.144892 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:01.144617 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:01.144892 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:01.144644 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:01.144892 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:01.144687 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.144667406 +0000 UTC m=+71.724346181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:01.144892 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:01.144705 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.144696324 +0000 UTC m=+71.724375064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : configmap "kube-rbac-proxy" not found Jul 01 19:24:01.265734 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:01.265705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6s7s_193fbd87-c73c-4148-99a2-4abf6667a86f/dns-node-resolver/0.log" Jul 01 19:24:02.208319 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.208255 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:24:02.208709 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.208643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/0.log" Jul 01 19:24:02.208709 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.208683 2578 generic.go:356] "Generic (PLEG): container finished" podID="bafb77da-2ae1-4563-9e7a-b08997f67e2a" containerID="9c518ce218715ab7d1003affafe7a9646f6a82531e17b33be6e7645cca9ff454" exitCode=255 Jul 01 19:24:02.208822 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.208768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" event={"ID":"bafb77da-2ae1-4563-9e7a-b08997f67e2a","Type":"ContainerDied","Data":"9c518ce218715ab7d1003affafe7a9646f6a82531e17b33be6e7645cca9ff454"} Jul 01 19:24:02.208880 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.208842 2578 scope.go:117] "RemoveContainer" containerID="b5dd6a730d72614c124ea8accf611f2aee682688ee2acc58d7f5bf0ab992d5ed" Jul 01 19:24:02.208977 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.208959 2578 scope.go:117] "RemoveContainer" containerID="9c518ce218715ab7d1003affafe7a9646f6a82531e17b33be6e7645cca9ff454" Jul 01 19:24:02.209129 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:02.209110 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4n62t_openshift-console-operator(bafb77da-2ae1-4563-9e7a-b08997f67e2a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" podUID="bafb77da-2ae1-4563-9e7a-b08997f67e2a" Jul 01 19:24:02.210260 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.210240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpgfm" event={"ID":"5f73ae23-bda9-4162-9550-d034f467c6e3","Type":"ContainerStarted","Data":"393676829d3d6d2970c1fa0a1464cbf7f74bf7c3f1173e8453a275c876907ce0"} Jul 01 19:24:02.210411 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.210397 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:24:02.211628 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.211609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-flz5h" event={"ID":"79bfe935-9410-4436-b3ca-a12a8991782d","Type":"ContainerStarted","Data":"39c6b56154f7a1fdbc6c48a1274bf4e2c55f979bcfa70d937724f28e821a8968"} Jul 01 19:24:02.266764 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.266728 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hpgfm" podStartSLOduration=64.670563871 podStartE2EDuration="1m9.266715358s" totalImagesPullingTime="4.596151487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:02.266298295 +0000 UTC m=+70.845977052" watchObservedRunningTime="2026-07-01 19:24:02.266715358 +0000 UTC m=+70.846394136" Jul 01 19:24:02.294482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.294447 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-flz5h" podStartSLOduration=64.668699108 podStartE2EDuration="1m9.2944353s" totalImagesPullingTime="4.625736192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:02.29409252 +0000 UTC m=+70.873771278" watchObservedRunningTime="2026-07-01 19:24:02.2944353 +0000 UTC m=+70.874114059" Jul 01 19:24:02.672740 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:02.672715 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t2jkw_e48339a1-bd04-418d-97bf-ea2a62afa2f0/node-ca/0.log" Jul 01 19:24:03.160038 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.160007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:03.160172 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.160051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:03.160172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.160124 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:03.160172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.160143 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:03.160172 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.160171 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:07.160159201 +0000 UTC m=+75.739837937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : configmap "kube-rbac-proxy" not found Jul 01 19:24:03.160329 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.160192 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:07.160179712 +0000 UTC m=+75.739858454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:03.215368 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.215349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:24:03.215707 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.215607 2578 scope.go:117] "RemoveContainer" containerID="9c518ce218715ab7d1003affafe7a9646f6a82531e17b33be6e7645cca9ff454" Jul 01 19:24:03.215754 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.215715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4n62t_openshift-console-operator(bafb77da-2ae1-4563-9e7a-b08997f67e2a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" podUID="bafb77da-2ae1-4563-9e7a-b08997f67e2a" Jul 01 19:24:03.266481 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.266464 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rk98g_30ca6c63-8e2e-4c35-a8b1-e1a67a42769a/serve-healthcheck-canary/0.log" Jul 01 19:24:03.362248 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.362200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:24:03.362399 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.362342 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:24:03.362399 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:03.362399 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls podName:1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b nodeName:}" failed. No retries permitted until 2026-07-01 19:24:11.362385436 +0000 UTC m=+79.942064176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-zc8z4" (UID: "1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b") : secret "samples-operator-tls" not found Jul 01 19:24:03.672800 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.672757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:03.730359 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.730338 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm"] Jul 01 19:24:03.763709 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.763691 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm"] Jul 01 19:24:03.763814 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.763773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" Jul 01 19:24:03.776342 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.776323 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 19:24:03.776817 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.776800 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 19:24:03.776999 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.776986 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hc2tb\"" Jul 01 19:24:03.803635 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.803614 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:03.865459 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.865439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrzz8\" (UniqueName: \"kubernetes.io/projected/5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67-kube-api-access-xrzz8\") pod \"migrator-786f9fbc5-qtkrm\" (UID: \"5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" Jul 01 19:24:03.885088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.885063 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:03.966531 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.966511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrzz8\" (UniqueName: \"kubernetes.io/projected/5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67-kube-api-access-xrzz8\") pod \"migrator-786f9fbc5-qtkrm\" (UID: \"5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" Jul 01 19:24:03.975663 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:03.975636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrzz8\" (UniqueName: \"kubernetes.io/projected/5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67-kube-api-access-xrzz8\") pod \"migrator-786f9fbc5-qtkrm\" (UID: \"5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" Jul 01 19:24:04.072340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:04.072310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" Jul 01 19:24:04.211657 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:04.211629 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm"] Jul 01 19:24:04.214351 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:04.214320 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc66d9b_9c24_4ab8_a6aa_b8b9dd456a67.slice/crio-ae28901895c76f20ba00064f58f11e09f308c7e2eb70fec9aa16c56301149333 WatchSource:0}: Error finding container ae28901895c76f20ba00064f58f11e09f308c7e2eb70fec9aa16c56301149333: Status 404 returned error can't find the container with id ae28901895c76f20ba00064f58f11e09f308c7e2eb70fec9aa16c56301149333 Jul 01 19:24:04.218857 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:04.218834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" event={"ID":"5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67","Type":"ContainerStarted","Data":"ae28901895c76f20ba00064f58f11e09f308c7e2eb70fec9aa16c56301149333"} Jul 01 19:24:04.369736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:04.369710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:04.369839 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:04.369827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:12.369814521 +0000 UTC m=+80.949493257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : configmap references non-existent config key: service-ca.crt Jul 01 19:24:04.470726 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:04.470683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:04.470825 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:04.470811 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:24:04.470864 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:04.470856 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:12.470844708 +0000 UTC m=+81.050523448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : secret "router-metrics-certs-default" not found Jul 01 19:24:04.969834 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:04.969805 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:05.037917 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.037885 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:05.541938 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.541906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:05.604149 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.604116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:05.679809 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.679773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:05.789843 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.789810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:05.993712 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.993696 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:24:05.993806 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.993746 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:24:05.994114 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:05.994096 2578 scope.go:117] "RemoveContainer" containerID="9c518ce218715ab7d1003affafe7a9646f6a82531e17b33be6e7645cca9ff454" Jul 01 19:24:05.994306 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:05.994285 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4n62t_openshift-console-operator(bafb77da-2ae1-4563-9e7a-b08997f67e2a)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" podUID="bafb77da-2ae1-4563-9e7a-b08997f67e2a" Jul 01 19:24:06.226291 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:06.226263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" event={"ID":"5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67","Type":"ContainerStarted","Data":"1ec0838cd6e6b7999133934d4e902f91cab4c48590c78272ed6dcc1d35bc515e"} Jul 01 19:24:06.226409 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:06.226309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" event={"ID":"5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67","Type":"ContainerStarted","Data":"93ad9488a3e3dbc874f13b04a18f92d9ff5921947b5d7759f24123caa848e74f"} Jul 01 19:24:06.243929 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:06.243884 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-qtkrm" podStartSLOduration=1.564736376 podStartE2EDuration="3.2438695s" totalImagesPullingTime="1.679133124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:06.242791182 +0000 UTC m=+74.822469942" watchObservedRunningTime="2026-07-01 19:24:06.2438695 +0000 UTC m=+74.823548266" Jul 01 19:24:06.321546 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:06.321518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:06.404639 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:06.404618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:07.191826 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:07.191790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:07.192180 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:07.191843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:07.192180 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:07.191938 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:07.192180 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:07.192000 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:15.19198672 +0000 UTC m=+83.771665461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:07.192180 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:07.191936 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:07.192180 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:07.192069 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:15.1920563 +0000 UTC m=+83.771735053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : configmap "kube-rbac-proxy" not found Jul 01 19:24:07.384096 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:07.384068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:07.482728 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:07.482696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:08.476856 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:08.476826 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:09.570327 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:09.570296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:09.764730 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:09.764701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:09.853074 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:09.853009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:09.922527 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:09.922503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:10.006990 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:10.006968 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:10.270783 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:10.270756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:10.862845 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:10.862819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:10.937624 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:10.937598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:11.422231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:11.422135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:24:11.424403 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:11.424380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-zc8z4\" (UID: \"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:24:11.464985 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:11.464958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:11.598534 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:11.598513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" Jul 01 19:24:11.716865 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:11.716836 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4"] Jul 01 19:24:12.064500 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.064434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.247242 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.247201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" event={"ID":"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b","Type":"ContainerStarted","Data":"b2b8c573e9d7187adbd3754a4ae1a00ddec79b46a35597190a06d4c527cbe398"} Jul 01 19:24:12.267053 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.267024 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.429129 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.429063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:12.429254 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:12.429198 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:28.429177506 +0000 UTC m=+97.008856249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : configmap references non-existent config key: service-ca.crt Jul 01 19:24:12.506655 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.506633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.530122 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.530103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:12.530203 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:12.530186 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:24:12.530259 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:12.530242 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs podName:0256c3cf-3b37-4daf-8bc0-2d56c2964def nodeName:}" failed. No retries permitted until 2026-07-01 19:24:28.530230608 +0000 UTC m=+97.109909350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs") pod "router-default-9d46b8597-b2hgl" (UID: "0256c3cf-3b37-4daf-8bc0-2d56c2964def") : secret "router-metrics-certs-default" not found Jul 01 19:24:12.645414 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.645389 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:12.873758 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:12.873725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:13.437536 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:13.437414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:13.519531 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:13.519492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:13.679170 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:13.679135 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:13.871588 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:13.871548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:14.063597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:14.063569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:14.164121 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:14.164057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:14.254463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:14.254436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" event={"ID":"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b","Type":"ContainerStarted","Data":"1cc4a9d39cad9da759394a1e8fe48087c132cb079e94217bc1058545660d4f07"} Jul 01 19:24:14.254575 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:14.254506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" event={"ID":"1f5f9776-43d3-42f7-9b63-4d71bb7cdd3b","Type":"ContainerStarted","Data":"137eba713f3118d602971dd8b95040ceec47076885fbe2ce320d8a38a156be45"} Jul 01 19:24:14.271348 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:14.271306 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-zc8z4" podStartSLOduration=17.099381022 podStartE2EDuration="19.271294434s" totalImagesPullingTime="2.171913412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:14.271002325 +0000 UTC m=+82.850681087" watchObservedRunningTime="2026-07-01 19:24:14.271294434 +0000 UTC m=+82.850973193" Jul 01 19:24:14.486035 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:14.485992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:15.064058 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:15.064021 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:15.251704 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:15.251681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:15.251836 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:15.251714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:15.251836 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:15.251818 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:15.251904 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:15.251874 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls podName:f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:31.251858536 +0000 UTC m=+99.831537274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-srhss" (UID: "f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:15.252171 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:15.252155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:15.344789 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:15.344739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:15.481688 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:15.481662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:16.134995 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:16.134960 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:16.468411 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:16.468384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:16.866925 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:16.866850 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:17.077750 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:17.077722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:17.262737 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:17.262710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:17.460614 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:17.460585 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:18.676096 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:18.676067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:18.871373 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:18.871337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:18.884648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:18.884633 2578 scope.go:117] "RemoveContainer" containerID="9c518ce218715ab7d1003affafe7a9646f6a82531e17b33be6e7645cca9ff454" Jul 01 19:24:19.102913 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.102878 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:19.265248 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.265225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:19.269643 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.269627 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:24:19.269751 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.269677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" event={"ID":"bafb77da-2ae1-4563-9e7a-b08997f67e2a","Type":"ContainerStarted","Data":"df94f9cb5a75b168a8c1aa29f0ba0e4f91eeb61e7e7b69f7ac57cb91fef234b2"} Jul 01 19:24:19.269913 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.269895 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:24:19.295655 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.292961 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" podStartSLOduration=22.105057214 podStartE2EDuration="24.292945306s" totalImagesPullingTime="2.187888092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:19.291636453 +0000 UTC m=+87.871315211" watchObservedRunningTime="2026-07-01 19:24:19.292945306 +0000 UTC m=+87.872624069" Jul 01 19:24:19.461463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.461440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:19.588413 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.588360 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4n62t" Jul 01 19:24:19.751474 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.751445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:19.852998 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.852924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:19.951938 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:19.951911 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:20.061808 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:20.061785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:20.119913 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:20.119857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:20.264128 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:20.264101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:20.445811 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:20.445749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:20.654103 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:20.654076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:20.726767 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:20.726744 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:21.052424 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:21.052358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:21.150291 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:21.150265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:21.262449 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:21.262424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:21.430105 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:21.430035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:21.497115 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:21.497093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:22.076908 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:22.076878 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.289498 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.289466 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6945cdf8f5-7czpg"] Jul 01 19:24:26.291648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.291628 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.294221 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.294183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:24:26.294327 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.294232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:24:26.294600 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.294580 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:24:26.295611 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.295594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fc4hm\"" Jul 01 19:24:26.302773 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.302757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:24:26.309011 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.308991 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6945cdf8f5-7czpg"] Jul 01 19:24:26.364176 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.364151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.429051 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-registry-certificates\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm7zj\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-kube-api-access-xm7zj\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-image-registry-private-configuration\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429301 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-installation-pull-secrets\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429301 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-trusted-ca\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429413 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-registry-tls\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429413 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-ca-trust-extracted\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.429413 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.429408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-bound-sa-token\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.461466 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.461438 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.530243 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-ca-trust-extracted\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530243 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-bound-sa-token\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530591 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-registry-certificates\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530591 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm7zj\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-kube-api-access-xm7zj\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530591 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-image-registry-private-configuration\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530591 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-installation-pull-secrets\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530591 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-trusted-ca\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530591 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-registry-tls\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.530884 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.530595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-ca-trust-extracted\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.531103 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.531071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-registry-certificates\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.531406 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.531386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-trusted-ca\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.532852 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.532825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-image-registry-private-configuration\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.533033 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.533012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-registry-tls\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.533074 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.533058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-installation-pull-secrets\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.542597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.542555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm7zj\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-kube-api-access-xm7zj\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.544866 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.544849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2-bound-sa-token\") pod \"image-registry-6945cdf8f5-7czpg\" (UID: \"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2\") " pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.565158 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.565133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:26.601188 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.601172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:26.727909 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:26.727881 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6945cdf8f5-7czpg"] Jul 01 19:24:26.731357 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:26.731323 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec2a28f_ab7f_4b0b_9d75_e98068b66ed2.slice/crio-d70b4f5700a0430a48fe14c266c12d9a041645d46ea00bb72f5a09c25bb6d47e WatchSource:0}: Error finding container d70b4f5700a0430a48fe14c266c12d9a041645d46ea00bb72f5a09c25bb6d47e: Status 404 returned error can't find the container with id d70b4f5700a0430a48fe14c266c12d9a041645d46ea00bb72f5a09c25bb6d47e Jul 01 19:24:27.019345 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.019313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:27.084366 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.084340 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:27.293568 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.293487 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" event={"ID":"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2","Type":"ContainerStarted","Data":"b31f88b537281faec7b7e7cbcf58c9edb1c85cad8fa6236c018a4441c7955499"} Jul 01 19:24:27.293568 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.293542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" event={"ID":"3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2","Type":"ContainerStarted","Data":"d70b4f5700a0430a48fe14c266c12d9a041645d46ea00bb72f5a09c25bb6d47e"} Jul 01 19:24:27.293931 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.293602 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:27.331529 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.331484 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" podStartSLOduration=1.331469498 podStartE2EDuration="1.331469498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:27.330341389 +0000 UTC m=+95.910020149" watchObservedRunningTime="2026-07-01 19:24:27.331469498 +0000 UTC m=+95.911148256" Jul 01 19:24:27.354689 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.354662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:27.451723 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:27.451695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:28.447517 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:28.447483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:28.448043 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:28.448024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0256c3cf-3b37-4daf-8bc0-2d56c2964def-service-ca-bundle\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:28.548485 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:28.548453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:28.550773 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:28.550754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0256c3cf-3b37-4daf-8bc0-2d56c2964def-metrics-certs\") pod \"router-default-9d46b8597-b2hgl\" (UID: \"0256c3cf-3b37-4daf-8bc0-2d56c2964def\") " pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:28.704190 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:28.704103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:28.828571 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:28.828539 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9d46b8597-b2hgl"] Jul 01 19:24:28.831110 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:28.831072 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0256c3cf_3b37_4daf_8bc0_2d56c2964def.slice/crio-e79f78c09391ea3747251df7cc0a5455aa77ff06b652ec1163d3fd844690a32f WatchSource:0}: Error finding container e79f78c09391ea3747251df7cc0a5455aa77ff06b652ec1163d3fd844690a32f: Status 404 returned error can't find the container with id e79f78c09391ea3747251df7cc0a5455aa77ff06b652ec1163d3fd844690a32f Jul 01 19:24:29.301059 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:29.301026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9d46b8597-b2hgl" event={"ID":"0256c3cf-3b37-4daf-8bc0-2d56c2964def","Type":"ContainerStarted","Data":"d6e4710b67a11919d119cc84e6de46d888ed3235b08434367b2f9b10e1cc28a3"} Jul 01 19:24:29.301199 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:29.301079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9d46b8597-b2hgl" event={"ID":"0256c3cf-3b37-4daf-8bc0-2d56c2964def","Type":"ContainerStarted","Data":"e79f78c09391ea3747251df7cc0a5455aa77ff06b652ec1163d3fd844690a32f"} Jul 01 19:24:29.327748 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:29.327688 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9d46b8597-b2hgl" podStartSLOduration=34.327672007 podStartE2EDuration="34.327672007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:29.32725228 +0000 UTC m=+97.906931039" watchObservedRunningTime="2026-07-01 19:24:29.327672007 +0000 UTC m=+97.907350768" Jul 01 19:24:29.705011 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:29.704929 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:29.707450 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:29.707427 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:30.304432 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:30.304402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:30.305564 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:30.305546 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9d46b8597-b2hgl" Jul 01 19:24:30.377038 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:30.377011 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.544411 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:30.544378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:30.882302 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:30.882275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:31.168007 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.167912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:24:31.170087 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.170068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d44382-6b98-4042-8601-6ebb97326b2b-metrics-tls\") pod \"dns-default-n4whx\" (UID: \"99d44382-6b98-4042-8601-6ebb97326b2b\") " pod="openshift-dns/dns-default-n4whx" Jul 01 19:24:31.189523 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.189503 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b6mr\"" Jul 01 19:24:31.197818 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.197799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4whx" Jul 01 19:24:31.269101 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.269042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:31.272283 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.272253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-srhss\" (UID: \"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23\") " pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:31.304881 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.304856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-srhss" Jul 01 19:24:31.343875 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.343850 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4whx"] Jul 01 19:24:31.346512 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:31.346491 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d44382_6b98_4042_8601_6ebb97326b2b.slice/crio-ff6f61b73248d8ecf218f94021321de3e79945e9bc2dba97c0ad75256e5da103 WatchSource:0}: Error finding container ff6f61b73248d8ecf218f94021321de3e79945e9bc2dba97c0ad75256e5da103: Status 404 returned error can't find the container with id ff6f61b73248d8ecf218f94021321de3e79945e9bc2dba97c0ad75256e5da103 Jul 01 19:24:31.447461 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:31.447383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-srhss"] Jul 01 19:24:31.450264 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:31.450243 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b4e8f5_6ff0_4a18_9a0a_5b219e70ac23.slice/crio-9e51e3a1d9f6ea854d2697da8b4d837f4315b34253ae4533dce2cff259203e00 WatchSource:0}: Error finding container 9e51e3a1d9f6ea854d2697da8b4d837f4315b34253ae4533dce2cff259203e00: Status 404 returned error can't find the container with id 9e51e3a1d9f6ea854d2697da8b4d837f4315b34253ae4533dce2cff259203e00 Jul 01 19:24:32.314803 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:32.314761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4whx" event={"ID":"99d44382-6b98-4042-8601-6ebb97326b2b","Type":"ContainerStarted","Data":"ff6f61b73248d8ecf218f94021321de3e79945e9bc2dba97c0ad75256e5da103"} Jul 01 19:24:32.316822 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:32.316789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srhss" event={"ID":"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23","Type":"ContainerStarted","Data":"9e51e3a1d9f6ea854d2697da8b4d837f4315b34253ae4533dce2cff259203e00"} Jul 01 19:24:33.217900 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:33.217871 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hpgfm" Jul 01 19:24:33.578259 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:33.578231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:33.678018 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:33.677992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:34.102067 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:34.102000 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:34.324916 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:34.324884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4whx" event={"ID":"99d44382-6b98-4042-8601-6ebb97326b2b","Type":"ContainerStarted","Data":"0c4553002a74acf3edf9a61b9841f2e7ca93d1094bf2cea84564035607e7638e"} Jul 01 19:24:34.325111 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:34.324940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4whx" event={"ID":"99d44382-6b98-4042-8601-6ebb97326b2b","Type":"ContainerStarted","Data":"1e810dfefb74212e0f9006d366a8683bcc49ccc1e967afb9c6991a6c5573394f"} Jul 01 19:24:34.325111 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:34.325014 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4whx" Jul 01 19:24:34.344746 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:34.344684 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4whx" podStartSLOduration=65.16193131 podStartE2EDuration="1m7.34466749s" totalImagesPullingTime="2.18273618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:34.342791532 +0000 UTC m=+102.922470291" watchObservedRunningTime="2026-07-01 19:24:34.34466749 +0000 UTC m=+102.924346285" Jul 01 19:24:36.049036 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:36.049005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:36.105134 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:36.105106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:36.333396 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:36.333326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srhss" event={"ID":"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23","Type":"ContainerStarted","Data":"52b9d57644ff8f0cd20471dab27db6febb0ed04399180dc9793c37c46e058663"} Jul 01 19:24:37.338173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:37.338142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srhss" event={"ID":"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23","Type":"ContainerStarted","Data":"330afc013f29040a2c0d34c6e54e3dab38d0aa27a92bff5e6dd570f3955290a0"} Jul 01 19:24:37.522169 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:37.522129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:37.595389 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:37.595312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:38.677832 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:38.677799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:38.747665 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:38.747634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:40.349162 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:40.349129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-srhss" event={"ID":"f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23","Type":"ContainerStarted","Data":"e7645c6bda9ada05f4c876ea121505dce912e0d11284944f52cf90a11c8518c8"} Jul 01 19:24:40.369877 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:40.369827 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-srhss" podStartSLOduration=33.439538869 podStartE2EDuration="41.36981436s" totalImagesPullingTime="7.930275491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:40.369363318 +0000 UTC m=+108.949042076" watchObservedRunningTime="2026-07-01 19:24:40.36981436 +0000 UTC m=+108.949493119" Jul 01 19:24:41.090242 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:41.090201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:41.167775 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:41.167740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:42.091438 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:42.091407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:42.192331 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:42.192302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:44.330308 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:44.330275 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4whx" Jul 01 19:24:46.605588 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:46.605556 2578 patch_prober.go:28] interesting pod/image-registry-6945cdf8f5-7czpg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 19:24:46.605947 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:46.605608 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" podUID="3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:24:47.000440 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:47.000407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:47.566343 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:47.566300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.301533 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:48.301502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6945cdf8f5-7czpg" Jul 01 19:24:48.433832 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:48.433802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.519346 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:48.519322 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:48.628619 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:48.628542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:49.727579 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.727550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:49.938220 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.938187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:49.983742 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.983679 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-fmll8"] Jul 01 19:24:49.989463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.989444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:49.992231 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.992196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 19:24:49.993697 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.993679 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:24:49.993802 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.993708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6wz5j\"" Jul 01 19:24:49.993802 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.993709 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 19:24:49.993802 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.993758 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:24:49.993802 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.993686 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:24:49.993966 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.993729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:24:49.999077 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:49.999057 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-fmll8"] Jul 01 19:24:50.005052 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.005034 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m67rx"] Jul 01 19:24:50.010354 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.010326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.013407 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.013389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:24:50.013485 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.013449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:24:50.013550 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.013532 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdcln\"" Jul 01 19:24:50.013830 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.013813 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:24:50.055251 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.055229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.108046 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f061c92-8071-4b8a-aa13-daf169b68882-metrics-client-ca\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.108165 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-textfile\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108165 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108265 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-accelerators-collector-config\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108265 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.108341 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-tls\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108382 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-root\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108427 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.108473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-sys\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-wtmp\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108473 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f67a155c-abee-487e-802c-963c7dd3d476-metrics-client-ca\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108586 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c98md\" (UniqueName: \"kubernetes.io/projected/f67a155c-abee-487e-802c-963c7dd3d476-kube-api-access-c98md\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.108586 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.108586 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7m2l\" (UniqueName: \"kubernetes.io/projected/9f061c92-8071-4b8a-aa13-daf169b68882-kube-api-access-v7m2l\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.108586 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.108565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9f061c92-8071-4b8a-aa13-daf169b68882-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.135334 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.135310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.209242 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f061c92-8071-4b8a-aa13-daf169b68882-metrics-client-ca\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.209375 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-textfile\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209375 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209375 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-accelerators-collector-config\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209375 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-tls\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-root\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-sys\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-wtmp\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-root\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f67a155c-abee-487e-802c-963c7dd3d476-metrics-client-ca\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209597 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98md\" (UniqueName: \"kubernetes.io/projected/f67a155c-abee-487e-802c-963c7dd3d476-kube-api-access-c98md\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209987 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-textfile\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209987 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-sys\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.209987 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.209987 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7m2l\" (UniqueName: \"kubernetes.io/projected/9f061c92-8071-4b8a-aa13-daf169b68882-kube-api-access-v7m2l\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.209987 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:50.209763 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:24:50.209987 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:50.209828 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-tls podName:f67a155c-abee-487e-802c-963c7dd3d476 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:50.709810528 +0000 UTC m=+119.289489286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-tls") pod "node-exporter-m67rx" (UID: "f67a155c-abee-487e-802c-963c7dd3d476") : secret "node-exporter-tls" not found Jul 01 19:24:50.210553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.210022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f67a155c-abee-487e-802c-963c7dd3d476-metrics-client-ca\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.210553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.209764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9f061c92-8071-4b8a-aa13-daf169b68882-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.210553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.210076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9f061c92-8071-4b8a-aa13-daf169b68882-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.210553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.210161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-wtmp\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.210812 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.210791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f061c92-8071-4b8a-aa13-daf169b68882-metrics-client-ca\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.210871 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.210805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-accelerators-collector-config\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.211263 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.211239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.211971 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.211947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.212392 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.212373 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.213074 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.213050 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f061c92-8071-4b8a-aa13-daf169b68882-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.220440 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.220415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c98md\" (UniqueName: \"kubernetes.io/projected/f67a155c-abee-487e-802c-963c7dd3d476-kube-api-access-c98md\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.220774 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.220755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7m2l\" (UniqueName: \"kubernetes.io/projected/9f061c92-8071-4b8a-aa13-daf169b68882-kube-api-access-v7m2l\") pod \"kube-state-metrics-845b954455-fmll8\" (UID: \"9f061c92-8071-4b8a-aa13-daf169b68882\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.248562 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.248506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.298845 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.298821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" Jul 01 19:24:50.358032 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.357995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.440829 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.440799 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-fmll8"] Jul 01 19:24:50.443561 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:50.443539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f061c92_8071_4b8a_aa13_daf169b68882.slice/crio-5baf22cd527ae05b85d00bc0135ac9092c2c20163e5bf2265215d5b1b2bb38af WatchSource:0}: Error finding container 5baf22cd527ae05b85d00bc0135ac9092c2c20163e5bf2265215d5b1b2bb38af: Status 404 returned error can't find the container with id 5baf22cd527ae05b85d00bc0135ac9092c2c20163e5bf2265215d5b1b2bb38af Jul 01 19:24:50.453627 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.453605 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:50.714561 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.714490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-tls\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.716653 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.716636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f67a155c-abee-487e-802c-963c7dd3d476-node-exporter-tls\") pod \"node-exporter-m67rx\" (UID: \"f67a155c-abee-487e-802c-963c7dd3d476\") " pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.919328 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.919302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m67rx" Jul 01 19:24:50.930438 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:50.930412 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67a155c_abee_487e_802c_963c7dd3d476.slice/crio-396c28480a121e0727f257e2b8e2f6a94be27d6f3b6249f1720a2cb3995ab731 WatchSource:0}: Error finding container 396c28480a121e0727f257e2b8e2f6a94be27d6f3b6249f1720a2cb3995ab731: Status 404 returned error can't find the container with id 396c28480a121e0727f257e2b8e2f6a94be27d6f3b6249f1720a2cb3995ab731 Jul 01 19:24:50.962567 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:50.962543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:51.063991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.063965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:51.072178 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.072148 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:24:51.075777 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.075762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.079028 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.079006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:24:51.079028 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.079037 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:24:51.079186 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.079006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:24:51.079330 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.079313 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:24:51.079519 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.079500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:24:51.081108 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.081089 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:24:51.081179 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.081110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:24:51.081808 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.081791 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xhhwk\"" Jul 01 19:24:51.083450 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.083435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:24:51.092489 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.092472 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:24:51.105076 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.105056 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:24:51.219434 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219434 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219661 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-web-config\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219661 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219661 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219661 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219864 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219864 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219864 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219864 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.219864 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.220083 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-out\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.220083 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.219924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqfw\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-kube-api-access-zhqfw\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.287774 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.287746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:51.320722 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320722 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320722 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-out\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqfw\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-kube-api-access-zhqfw\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:51.320869 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-web-config\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:51.320947 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls podName:f2d23233-70a2-44c3-8537-280f6bc4aae9 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:51.820927633 +0000 UTC m=+120.400606376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9") : secret "alertmanager-main-tls" not found Jul 01 19:24:51.320969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.320970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.321537 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.321008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.321537 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.321035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.321537 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.321066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.321537 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.321440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.321847 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.321822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.322143 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:51.322124 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle podName:f2d23233-70a2-44c3-8537-280f6bc4aae9 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:51.82210642 +0000 UTC m=+120.401785161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9") : configmap references non-existent config key: ca-bundle.crt Jul 01 19:24:51.324441 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.324021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.327161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.324483 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.327161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.325109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.327161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.325418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.327161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.326481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-out\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.327161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.326448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-web-config\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.327161 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.326909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.328387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.328368 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.332399 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.332375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqfw\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-kube-api-access-zhqfw\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.385410 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.385371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" event={"ID":"9f061c92-8071-4b8a-aa13-daf169b68882","Type":"ContainerStarted","Data":"5baf22cd527ae05b85d00bc0135ac9092c2c20163e5bf2265215d5b1b2bb38af"} Jul 01 19:24:51.386596 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.386574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m67rx" event={"ID":"f67a155c-abee-487e-802c-963c7dd3d476","Type":"ContainerStarted","Data":"396c28480a121e0727f257e2b8e2f6a94be27d6f3b6249f1720a2cb3995ab731"} Jul 01 19:24:51.770140 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.770065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:51.825585 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.825554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.825700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.825672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.828229 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.828175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.838880 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.838854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:51.988730 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.988632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xhhwk\"" Jul 01 19:24:51.996757 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:51.996736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:52.355272 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.355256 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:24:52.357742 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:52.357720 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d23233_70a2_44c3_8537_280f6bc4aae9.slice/crio-bb580eadb1c1542fbf7c1ba742847d921594b731b9255adc39f69b878520cf27 WatchSource:0}: Error finding container bb580eadb1c1542fbf7c1ba742847d921594b731b9255adc39f69b878520cf27: Status 404 returned error can't find the container with id bb580eadb1c1542fbf7c1ba742847d921594b731b9255adc39f69b878520cf27 Jul 01 19:24:52.391982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.391956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" event={"ID":"9f061c92-8071-4b8a-aa13-daf169b68882","Type":"ContainerStarted","Data":"70f22f07e9070bfb1a741d99cc138d230569f65141d2b1600880f54caad7d70d"} Jul 01 19:24:52.392115 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.392009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" event={"ID":"9f061c92-8071-4b8a-aa13-daf169b68882","Type":"ContainerStarted","Data":"e6db3d0ff4baad689aaf9163fd6b42ac1ee2c62c72d22758ebbd41936fa31315"} Jul 01 19:24:52.392115 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.392042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" event={"ID":"9f061c92-8071-4b8a-aa13-daf169b68882","Type":"ContainerStarted","Data":"034405ebf1af6029939617dcf27fbb89a741757127a3335f2ffa23e08010a44d"} Jul 01 19:24:52.393404 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.393384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m67rx" event={"ID":"f67a155c-abee-487e-802c-963c7dd3d476","Type":"ContainerStarted","Data":"5a1a7f43331a64751f97d02eef8f50d942dbf8f2b586aa7f32c9aa3de673e7b4"} Jul 01 19:24:52.394545 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.394521 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"bb580eadb1c1542fbf7c1ba742847d921594b731b9255adc39f69b878520cf27"} Jul 01 19:24:52.420780 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.420742 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-fmll8" podStartSLOduration=2.175047024 podStartE2EDuration="3.420729095s" totalImagesPullingTime="1.245682071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:52.418904183 +0000 UTC m=+120.998582943" watchObservedRunningTime="2026-07-01 19:24:52.420729095 +0000 UTC m=+121.000407853" Jul 01 19:24:52.965885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:52.965839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:53.067682 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.067644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:53.167768 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.167731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:53.399458 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.399428 2578 generic.go:356] "Generic (PLEG): container finished" podID="f67a155c-abee-487e-802c-963c7dd3d476" containerID="5a1a7f43331a64751f97d02eef8f50d942dbf8f2b586aa7f32c9aa3de673e7b4" exitCode=0 Jul 01 19:24:53.399568 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.399516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m67rx" event={"ID":"f67a155c-abee-487e-802c-963c7dd3d476","Type":"ContainerDied","Data":"5a1a7f43331a64751f97d02eef8f50d942dbf8f2b586aa7f32c9aa3de673e7b4"} Jul 01 19:24:53.407736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.407548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:53.501493 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.501462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:53.607268 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:53.607235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:54.407544 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.407512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m67rx" event={"ID":"f67a155c-abee-487e-802c-963c7dd3d476","Type":"ContainerStarted","Data":"7e1508a836e4beb6ccbdf21ec76d6c2ef9e4c1868d69056d80b906d1239d3692"} Jul 01 19:24:54.407911 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.407567 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m67rx" event={"ID":"f67a155c-abee-487e-802c-963c7dd3d476","Type":"ContainerStarted","Data":"8d9c29db4955771ca22a9ae10dbf31211e6c0c2aabf9dab8ec334f24287b360e"} Jul 01 19:24:54.408998 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.408978 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41" exitCode=0 Jul 01 19:24:54.409064 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.409051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41"} Jul 01 19:24:54.435930 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.435886 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m67rx" podStartSLOduration=4.044906606 podStartE2EDuration="5.435872513s" totalImagesPullingTime="1.32676854s" totalInitContainerRuntime="64.197367ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:54.434943847 +0000 UTC m=+123.014622606" watchObservedRunningTime="2026-07-01 19:24:54.435872513 +0000 UTC m=+123.015551282" Jul 01 19:24:54.790102 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.790071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:54.795702 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.795668 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-l65cl"] Jul 01 19:24:54.798805 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.798785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:54.801910 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.801894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 19:24:54.802031 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.801900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mw4gv\"" Jul 01 19:24:54.808672 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.808646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-l65cl"] Jul 01 19:24:54.882649 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.882621 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:54.951044 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.951012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gh59\" (UniqueName: \"kubernetes.io/projected/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-kube-api-access-2gh59\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:54.951186 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:54.951091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.052403 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.052318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.052403 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.052358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gh59\" (UniqueName: \"kubernetes.io/projected/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-kube-api-access-2gh59\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.052618 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:55.052494 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 01 19:24:55.052618 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:24:55.052566 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-monitoring-plugin-cert podName:0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:55.552547007 +0000 UTC m=+124.132225750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-l65cl" (UID: "0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48") : secret "monitoring-plugin-cert" not found Jul 01 19:24:55.065354 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.065331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gh59\" (UniqueName: \"kubernetes.io/projected/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-kube-api-access-2gh59\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.176863 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.176831 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b4f8ff48-slnsb"] Jul 01 19:24:55.179915 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.179900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.182969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.182946 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:24:55.183078 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:24:55.183078 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183053 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:24:55.183276 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183091 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:24:55.183276 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183173 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:24:55.183367 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vq2mg\"" Jul 01 19:24:55.183367 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:24:55.183615 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.183601 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:24:55.189284 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.189264 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:24:55.193590 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.193568 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b4f8ff48-slnsb"] Jul 01 19:24:55.355379 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-config\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.355379 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-service-ca\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.355379 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46c4x\" (UniqueName: \"kubernetes.io/projected/99d73e84-2a7a-4de0-abb5-9946b56173fd-kube-api-access-46c4x\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.355653 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-serving-cert\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.355653 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-oauth-config\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.355653 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-oauth-serving-cert\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.355653 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.355552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-trusted-ca-bundle\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.408272 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.408239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:55.456829 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-config\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.456945 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-service-ca\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.456945 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46c4x\" (UniqueName: \"kubernetes.io/projected/99d73e84-2a7a-4de0-abb5-9946b56173fd-kube-api-access-46c4x\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.456945 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-serving-cert\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.456945 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-oauth-config\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.457107 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-oauth-serving-cert\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.457107 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.456982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-trusted-ca-bundle\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.457627 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.457600 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-config\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.457729 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.457662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-service-ca\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.457729 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.457664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-oauth-serving-cert\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.457850 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.457779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-trusted-ca-bundle\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.459348 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.459320 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-serving-cert\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.459448 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.459380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-oauth-config\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.467920 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.467889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46c4x\" (UniqueName: \"kubernetes.io/projected/99d73e84-2a7a-4de0-abb5-9946b56173fd-kube-api-access-46c4x\") pod \"console-75b4f8ff48-slnsb\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.489875 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.489854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:24:55.511183 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.511157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:55.558147 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.558118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.561736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.561689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-l65cl\" (UID: \"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.610043 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.609978 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:55.636556 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.636442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b4f8ff48-slnsb"] Jul 01 19:24:55.638943 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:55.638916 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d73e84_2a7a_4de0_abb5_9946b56173fd.slice/crio-3da5eb22995ebbc18dddd3ec2ec67a7b6593a9f4c4e591eb00d14a65e3a2d761 WatchSource:0}: Error finding container 3da5eb22995ebbc18dddd3ec2ec67a7b6593a9f4c4e591eb00d14a65e3a2d761: Status 404 returned error can't find the container with id 3da5eb22995ebbc18dddd3ec2ec67a7b6593a9f4c4e591eb00d14a65e3a2d761 Jul 01 19:24:55.709217 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.709180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:55.846734 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:55.846592 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-l65cl"] Jul 01 19:24:56.132172 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:56.132133 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6d5fe6_c38a_47fe_a4ef_d9e6e4f26c48.slice/crio-ae85278982e08288a56b561ece47fbe536bcd23f0b939e037db91e3a92147dd2 WatchSource:0}: Error finding container ae85278982e08288a56b561ece47fbe536bcd23f0b939e037db91e3a92147dd2: Status 404 returned error can't find the container with id ae85278982e08288a56b561ece47fbe536bcd23f0b939e037db91e3a92147dd2 Jul 01 19:24:56.282999 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.282976 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:24:56.287736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.287716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.288864 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.288837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:56.291072 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291053 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:24:56.291387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:24:56.291387 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:24:56.291549 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291363 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:24:56.291677 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291654 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:24:56.291753 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:24:56.291753 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.291697 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:24:56.292409 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:24:56.292409 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-njdpp\"" Jul 01 19:24:56.292553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292458 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:24:56.292743 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:24:56.292850 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292769 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:24:56.292923 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:24:56.292923 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:24:56.293031 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9s4bkl4p5f6gq\"" Jul 01 19:24:56.293031 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.292813 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:24:56.294065 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.294045 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:24:56.310401 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.310378 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:24:56.418506 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.418483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b4f8ff48-slnsb" event={"ID":"99d73e84-2a7a-4de0-abb5-9946b56173fd","Type":"ContainerStarted","Data":"3da5eb22995ebbc18dddd3ec2ec67a7b6593a9f4c4e591eb00d14a65e3a2d761"} Jul 01 19:24:56.422228 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.421996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2"} Jul 01 19:24:56.422228 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.422068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678"} Jul 01 19:24:56.422228 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.422109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41"} Jul 01 19:24:56.422228 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.422148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9"} Jul 01 19:24:56.424051 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.424025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" event={"ID":"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48","Type":"ContainerStarted","Data":"ae85278982e08288a56b561ece47fbe536bcd23f0b939e037db91e3a92147dd2"} Jul 01 19:24:56.467023 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.466997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467118 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467156 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467156 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467242 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467292 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467365 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467400 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467442 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467442 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467520 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467550 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467584 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467637 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467673 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467705 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467735 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467813 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-config\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467845 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.467873 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.467855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzn2\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-kube-api-access-tqzn2\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568523 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-config\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzn2\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-kube-api-access-tqzn2\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.568969 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.568972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569445 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569445 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569445 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569445 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569445 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569445 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.569720 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.569507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.570632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.570334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.570632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.570472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.570794 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.570651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.571553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.571525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.571793 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.571766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.572042 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.572013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.572165 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.572149 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.573329 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.573303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.574035 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.573998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.574420 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.574395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.574714 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.574690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.575003 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.574958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-config\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.575118 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.575014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.575118 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.575110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.575260 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.575197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.575944 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.575908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.576409 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.576389 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.579066 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.579048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzn2\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-kube-api-access-tqzn2\") pod \"prometheus-k8s-0\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.599131 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.599109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:24:56.773618 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:56.773517 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:24:56.776729 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:24:56.776698 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2de5427_5969_4425_8484_ecff425e2727.slice/crio-c2e37dac931c94a5669db74cebf68373ba2810ab0d6c3b407632f10af34a3eb6 WatchSource:0}: Error finding container c2e37dac931c94a5669db74cebf68373ba2810ab0d6c3b407632f10af34a3eb6: Status 404 returned error can't find the container with id c2e37dac931c94a5669db74cebf68373ba2810ab0d6c3b407632f10af34a3eb6 Jul 01 19:24:57.332383 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.332325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:57.435617 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.435513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183"} Jul 01 19:24:57.435617 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.435595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerStarted","Data":"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181"} Jul 01 19:24:57.437462 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.437438 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" exitCode=0 Jul 01 19:24:57.437566 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.437517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} Jul 01 19:24:57.437628 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.437612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"c2e37dac931c94a5669db74cebf68373ba2810ab0d6c3b407632f10af34a3eb6"} Jul 01 19:24:57.457663 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.457622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:57.469297 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:57.469245 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.833653911 podStartE2EDuration="6.469227425s" totalImagesPullingTime="3.62025852s" totalInitContainerRuntime="15.314994ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:57.466289626 +0000 UTC m=+126.045968380" watchObservedRunningTime="2026-07-01 19:24:57.469227425 +0000 UTC m=+126.048906167" Jul 01 19:24:58.671050 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:58.671012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:58.742587 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:58.742559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:24:59.448961 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:59.448921 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" event={"ID":"0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48","Type":"ContainerStarted","Data":"fd307b34e98c82271cc8ffd4ff45b870d2b9407bbe6a98ec3920c4f692adbfdd"} Jul 01 19:24:59.449148 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:59.448984 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:59.451015 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:59.450963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b4f8ff48-slnsb" event={"ID":"99d73e84-2a7a-4de0-abb5-9946b56173fd","Type":"ContainerStarted","Data":"67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca"} Jul 01 19:24:59.454753 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:59.454726 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" Jul 01 19:24:59.468951 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:59.468898 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-l65cl" podStartSLOduration=2.720694181 podStartE2EDuration="5.468878482s" totalImagesPullingTime="2.748184301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:59.468097113 +0000 UTC m=+128.047775873" watchObservedRunningTime="2026-07-01 19:24:59.468878482 +0000 UTC m=+128.048557243" Jul 01 19:24:59.489354 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:24:59.489309 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b4f8ff48-slnsb" podStartSLOduration=1.241310366 podStartE2EDuration="4.489295245s" totalImagesPullingTime="3.247984879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:59.487925648 +0000 UTC m=+128.067604409" watchObservedRunningTime="2026-07-01 19:24:59.489295245 +0000 UTC m=+128.068974003" Jul 01 19:25:00.147921 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:00.147888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:00.245285 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:00.245252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:00.706705 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:00.706665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:25:00.709356 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:00.709327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a29044a-b5a6-4b29-8cd8-58fab4b0b59b-metrics-certs\") pod \"network-metrics-daemon-q6djp\" (UID: \"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b\") " pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:25:00.906128 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:00.906098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqcw7\"" Jul 01 19:25:00.913678 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:00.913651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6djp" Jul 01 19:25:01.832220 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:01.832185 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b4f8ff48-slnsb"] Jul 01 19:25:01.961937 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:01.961912 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6djp"] Jul 01 19:25:01.963232 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:25:01.963189 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a29044a_b5a6_4b29_8cd8_58fab4b0b59b.slice/crio-3ceaed947b48f61b002c368599ff96b04b9dd55dff9f4f0cad8eb8787e746add WatchSource:0}: Error finding container 3ceaed947b48f61b002c368599ff96b04b9dd55dff9f4f0cad8eb8787e746add: Status 404 returned error can't find the container with id 3ceaed947b48f61b002c368599ff96b04b9dd55dff9f4f0cad8eb8787e746add Jul 01 19:25:02.466017 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:02.465985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} Jul 01 19:25:02.466155 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:02.466049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} Jul 01 19:25:02.466972 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:02.466948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6djp" event={"ID":"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b","Type":"ContainerStarted","Data":"3ceaed947b48f61b002c368599ff96b04b9dd55dff9f4f0cad8eb8787e746add"} Jul 01 19:25:03.472516 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:03.472481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6djp" event={"ID":"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b","Type":"ContainerStarted","Data":"7321dac3b6c072f2a8c450fd4b5c531c0d4bfef3fe9ffce76ad0b8846b8c172e"} Jul 01 19:25:04.477691 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:04.477652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6djp" event={"ID":"7a29044a-b5a6-4b29-8cd8-58fab4b0b59b","Type":"ContainerStarted","Data":"5096b259b7f1bb6d0c6cd7009a560b89925fbff56e55cb2739520ed0b4506eaa"} Jul 01 19:25:04.495757 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:04.495695 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q6djp" podStartSLOduration=130.098255911 podStartE2EDuration="2m11.495680228s" totalImagesPullingTime="1.397424317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:04.493869459 +0000 UTC m=+133.073548258" watchObservedRunningTime="2026-07-01 19:25:04.495680228 +0000 UTC m=+133.075358986" Jul 01 19:25:04.615422 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:04.615393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:04.684322 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:04.684276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:05.484677 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:05.484649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} Jul 01 19:25:05.484952 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:05.484716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} Jul 01 19:25:05.484952 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:05.484743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} Jul 01 19:25:05.490885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:05.490866 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:25:06.050260 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.050200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:06.122906 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.122881 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:06.432567 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.432498 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:06.490680 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.490650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerStarted","Data":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} Jul 01 19:25:06.533404 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.533353 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.854897695 podStartE2EDuration="10.533333315s" totalImagesPullingTime="7.656376899s" totalInitContainerRuntime="22.058721ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:06.531711413 +0000 UTC m=+135.111390173" watchObservedRunningTime="2026-07-01 19:25:06.533333315 +0000 UTC m=+135.113012075" Jul 01 19:25:06.572295 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.572268 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:06.600195 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:06.600162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:07.001728 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:07.001694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:07.088044 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:07.088013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:09.101624 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:09.101592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:09.188674 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:09.188645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:13.152920 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:13.152885 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:13.254840 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:13.254809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:13.580771 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:13.580747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:13.681168 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:13.681142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:21.092511 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:21.092476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:21.193460 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:21.193431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:21.294737 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:21.294711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:26.854340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:26.854285 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75b4f8ff48-slnsb" podUID="99d73e84-2a7a-4de0-abb5-9946b56173fd" containerName="console" containerID="cri-o://67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca" gracePeriod=15 Jul 01 19:25:27.125785 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.125761 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:25:27.228497 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-serving-cert\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.228497 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228500 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-oauth-serving-cert\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.228725 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228540 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-service-ca\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.228725 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228588 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-trusted-ca-bundle\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.228725 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228655 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46c4x\" (UniqueName: \"kubernetes.io/projected/99d73e84-2a7a-4de0-abb5-9946b56173fd-kube-api-access-46c4x\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.228725 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228679 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-config\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.228725 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228712 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-oauth-config\") pod \"99d73e84-2a7a-4de0-abb5-9946b56173fd\" (UID: \"99d73e84-2a7a-4de0-abb5-9946b56173fd\") " Jul 01 19:25:27.229286 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228848 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:27.229286 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228952 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:27.229286 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.228961 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-oauth-serving-cert\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.229286 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.229021 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:27.229446 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.229280 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-config" (OuterVolumeSpecName: "console-config") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:27.230839 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.230811 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:27.230839 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.230826 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99d73e84-2a7a-4de0-abb5-9946b56173fd-kube-api-access-46c4x" (OuterVolumeSpecName: "kube-api-access-46c4x") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "kube-api-access-46c4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:27.230965 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.230887 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "99d73e84-2a7a-4de0-abb5-9946b56173fd" (UID: "99d73e84-2a7a-4de0-abb5-9946b56173fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:27.329698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.329658 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-service-ca\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.329698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.329693 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-trusted-ca-bundle\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.329698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.329703 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46c4x\" (UniqueName: \"kubernetes.io/projected/99d73e84-2a7a-4de0-abb5-9946b56173fd-kube-api-access-46c4x\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.329867 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.329711 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-config\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.329867 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.329719 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-oauth-config\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.329867 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.329727 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99d73e84-2a7a-4de0-abb5-9946b56173fd-console-serving-cert\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:25:27.570274 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.570243 2578 generic.go:356] "Generic (PLEG): container finished" podID="99d73e84-2a7a-4de0-abb5-9946b56173fd" containerID="67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca" exitCode=0 Jul 01 19:25:27.570405 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.570286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b4f8ff48-slnsb" event={"ID":"99d73e84-2a7a-4de0-abb5-9946b56173fd","Type":"ContainerDied","Data":"67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca"} Jul 01 19:25:27.570405 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.570291 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b4f8ff48-slnsb" Jul 01 19:25:27.570405 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.570324 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b4f8ff48-slnsb" event={"ID":"99d73e84-2a7a-4de0-abb5-9946b56173fd","Type":"ContainerDied","Data":"3da5eb22995ebbc18dddd3ec2ec67a7b6593a9f4c4e591eb00d14a65e3a2d761"} Jul 01 19:25:27.570405 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.570343 2578 scope.go:117] "RemoveContainer" containerID="67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca" Jul 01 19:25:27.578736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.578718 2578 scope.go:117] "RemoveContainer" containerID="67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca" Jul 01 19:25:27.578971 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:25:27.578948 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca\": container with ID starting with 67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca not found: ID does not exist" containerID="67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca" Jul 01 19:25:27.579044 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.578979 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca"} err="failed to get container status \"67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca\": rpc error: code = NotFound desc = could not find container \"67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca\": container with ID starting with 67fb615f7748b55ba22cd403f8991a772003b33b277958270e58d3b390a90dca not found: ID does not exist" Jul 01 19:25:27.592100 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.592073 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b4f8ff48-slnsb"] Jul 01 19:25:27.596462 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.596442 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75b4f8ff48-slnsb"] Jul 01 19:25:27.889083 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:27.889008 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99d73e84-2a7a-4de0-abb5-9946b56173fd" path="/var/lib/kubelet/pods/99d73e84-2a7a-4de0-abb5-9946b56173fd/volumes" Jul 01 19:25:30.267592 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:30.267561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:25:56.600294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:56.600260 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:56.616264 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:56.616244 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:25:56.694398 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:25:56.694372 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:06.204021 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:06.203988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:06.279548 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:06.279513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:10.638810 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.638777 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:10.707654 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.707618 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:26:10.707988 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.707963 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="alertmanager" containerID="cri-o://f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9" gracePeriod=120 Jul 01 19:26:10.708104 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.708046 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-web" containerID="cri-o://987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678" gracePeriod=120 Jul 01 19:26:10.708104 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.708070 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-metric" containerID="cri-o://229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181" gracePeriod=120 Jul 01 19:26:10.708239 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.708101 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy" containerID="cri-o://061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2" gracePeriod=120 Jul 01 19:26:10.708239 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.708148 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="prom-label-proxy" containerID="cri-o://26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183" gracePeriod=120 Jul 01 19:26:10.708239 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.708100 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="config-reloader" containerID="cri-o://7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41" gracePeriod=120 Jul 01 19:26:10.736068 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.736022 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:10.830152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:10.830128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:11.332855 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.332828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:11.432156 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.432123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:11.743070 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743039 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183" exitCode=0 Jul 01 19:26:11.743070 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743063 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2" exitCode=0 Jul 01 19:26:11.743070 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743069 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41" exitCode=0 Jul 01 19:26:11.743512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743077 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9" exitCode=0 Jul 01 19:26:11.743512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183"} Jul 01 19:26:11.743512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2"} Jul 01 19:26:11.743512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41"} Jul 01 19:26:11.743512 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.743239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9"} Jul 01 19:26:11.948120 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.948094 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:11.985091 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985068 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-out\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985170 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985099 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985170 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985118 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-main-db\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985170 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985134 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985352 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985260 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-tls-assets\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985352 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985294 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-volume\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985352 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985325 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhqfw\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-kube-api-access-zhqfw\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985495 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985373 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985495 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985406 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-web\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985495 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985448 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-cluster-tls-config\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985495 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985449 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:26:11.985693 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985493 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985693 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985526 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-web-config\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.985693 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.985560 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-metrics-client-ca\") pod \"f2d23233-70a2-44c3-8537-280f6bc4aae9\" (UID: \"f2d23233-70a2-44c3-8537-280f6bc4aae9\") " Jul 01 19:26:11.987293 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.987070 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-main-db\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:11.987293 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.987153 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:11.987804 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.987769 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:11.988608 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.988582 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-kube-api-access-zhqfw" (OuterVolumeSpecName: "kube-api-access-zhqfw") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "kube-api-access-zhqfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:11.988956 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.988834 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:11.988956 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.988923 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-out" (OuterVolumeSpecName: "config-out") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:26:11.988956 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.988938 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:11.989146 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.989023 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:11.989146 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.989072 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:11.990942 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.990918 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:11.996406 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:11.994666 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-volume" (OuterVolumeSpecName: "config-volume") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:12.003230 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.003190 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:12.008426 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.008405 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-web-config" (OuterVolumeSpecName: "web-config") pod "f2d23233-70a2-44c3-8537-280f6bc4aae9" (UID: "f2d23233-70a2-44c3-8537-280f6bc4aae9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:12.087983 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.087955 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-cluster-tls-config\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.087983 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.087980 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088009 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-web-config\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088019 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d23233-70a2-44c3-8537-280f6bc4aae9-metrics-client-ca\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088028 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-out\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088037 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088046 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-main-tls\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088054 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-tls-assets\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088068 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-config-volume\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088076 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhqfw\" (UniqueName: \"kubernetes.io/projected/f2d23233-70a2-44c3-8537-280f6bc4aae9-kube-api-access-zhqfw\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088084 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.088127 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.088093 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2d23233-70a2-44c3-8537-280f6bc4aae9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:12.749788 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749756 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181" exitCode=0 Jul 01 19:26:12.749788 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749782 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerID="987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678" exitCode=0 Jul 01 19:26:12.750173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181"} Jul 01 19:26:12.750173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749840 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.750173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678"} Jul 01 19:26:12.750173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2d23233-70a2-44c3-8537-280f6bc4aae9","Type":"ContainerDied","Data":"bb580eadb1c1542fbf7c1ba742847d921594b731b9255adc39f69b878520cf27"} Jul 01 19:26:12.750173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.749955 2578 scope.go:117] "RemoveContainer" containerID="26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183" Jul 01 19:26:12.757538 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.757519 2578 scope.go:117] "RemoveContainer" containerID="229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181" Jul 01 19:26:12.764218 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.764193 2578 scope.go:117] "RemoveContainer" containerID="061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2" Jul 01 19:26:12.770335 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.770320 2578 scope.go:117] "RemoveContainer" containerID="987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678" Jul 01 19:26:12.777026 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.777005 2578 scope.go:117] "RemoveContainer" containerID="7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41" Jul 01 19:26:12.778538 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.778519 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:26:12.782132 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.782113 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:26:12.784569 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.784552 2578 scope.go:117] "RemoveContainer" containerID="f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9" Jul 01 19:26:12.791431 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.791401 2578 scope.go:117] "RemoveContainer" containerID="01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41" Jul 01 19:26:12.800572 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.800373 2578 scope.go:117] "RemoveContainer" containerID="26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183" Jul 01 19:26:12.800676 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.800653 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183\": container with ID starting with 26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183 not found: ID does not exist" containerID="26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183" Jul 01 19:26:12.800736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.800685 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183"} err="failed to get container status \"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183\": rpc error: code = NotFound desc = could not find container \"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183\": container with ID starting with 26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183 not found: ID does not exist" Jul 01 19:26:12.800736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.800709 2578 scope.go:117] "RemoveContainer" containerID="229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181" Jul 01 19:26:12.800977 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.800961 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181\": container with ID starting with 229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181 not found: ID does not exist" containerID="229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181" Jul 01 19:26:12.801016 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.800982 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181"} err="failed to get container status \"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181\": rpc error: code = NotFound desc = could not find container \"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181\": container with ID starting with 229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181 not found: ID does not exist" Jul 01 19:26:12.801016 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.800996 2578 scope.go:117] "RemoveContainer" containerID="061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2" Jul 01 19:26:12.801255 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.801231 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2\": container with ID starting with 061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2 not found: ID does not exist" containerID="061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2" Jul 01 19:26:12.801308 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801264 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2"} err="failed to get container status \"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2\": rpc error: code = NotFound desc = could not find container \"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2\": container with ID starting with 061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2 not found: ID does not exist" Jul 01 19:26:12.801308 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801281 2578 scope.go:117] "RemoveContainer" containerID="987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678" Jul 01 19:26:12.801521 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.801505 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678\": container with ID starting with 987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678 not found: ID does not exist" containerID="987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678" Jul 01 19:26:12.801561 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801525 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678"} err="failed to get container status \"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678\": rpc error: code = NotFound desc = could not find container \"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678\": container with ID starting with 987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678 not found: ID does not exist" Jul 01 19:26:12.801561 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801538 2578 scope.go:117] "RemoveContainer" containerID="7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41" Jul 01 19:26:12.801753 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.801739 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41\": container with ID starting with 7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41 not found: ID does not exist" containerID="7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41" Jul 01 19:26:12.801792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801757 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41"} err="failed to get container status \"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41\": rpc error: code = NotFound desc = could not find container \"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41\": container with ID starting with 7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41 not found: ID does not exist" Jul 01 19:26:12.801792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801768 2578 scope.go:117] "RemoveContainer" containerID="f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9" Jul 01 19:26:12.801980 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.801963 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9\": container with ID starting with f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9 not found: ID does not exist" containerID="f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9" Jul 01 19:26:12.802019 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.801987 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9"} err="failed to get container status \"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9\": rpc error: code = NotFound desc = could not find container \"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9\": container with ID starting with f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9 not found: ID does not exist" Jul 01 19:26:12.802019 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802000 2578 scope.go:117] "RemoveContainer" containerID="01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41" Jul 01 19:26:12.802235 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:12.802200 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41\": container with ID starting with 01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41 not found: ID does not exist" containerID="01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41" Jul 01 19:26:12.802285 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802238 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41"} err="failed to get container status \"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41\": rpc error: code = NotFound desc = could not find container \"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41\": container with ID starting with 01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41 not found: ID does not exist" Jul 01 19:26:12.802285 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802250 2578 scope.go:117] "RemoveContainer" containerID="26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183" Jul 01 19:26:12.802467 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802451 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183"} err="failed to get container status \"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183\": rpc error: code = NotFound desc = could not find container \"26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183\": container with ID starting with 26a4b3891349906bc1fe43737839e9fa569ace400d9139c4769f7fc52f0fa183 not found: ID does not exist" Jul 01 19:26:12.802511 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802468 2578 scope.go:117] "RemoveContainer" containerID="229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181" Jul 01 19:26:12.802648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802632 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181"} err="failed to get container status \"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181\": rpc error: code = NotFound desc = could not find container \"229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181\": container with ID starting with 229a440624e75e34bf0090ee58b0fc508dab7d64b4f2fd28a612b03d34088181 not found: ID does not exist" Jul 01 19:26:12.802684 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802648 2578 scope.go:117] "RemoveContainer" containerID="061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2" Jul 01 19:26:12.802838 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802821 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2"} err="failed to get container status \"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2\": rpc error: code = NotFound desc = could not find container \"061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2\": container with ID starting with 061142f581e40767bc48a05c33174cbe397fe1995259404f28b57999900417e2 not found: ID does not exist" Jul 01 19:26:12.802878 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.802839 2578 scope.go:117] "RemoveContainer" containerID="987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678" Jul 01 19:26:12.803061 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803043 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678"} err="failed to get container status \"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678\": rpc error: code = NotFound desc = could not find container \"987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678\": container with ID starting with 987779c9cddd0d330d524f53e91c29ad372e9a8e8dc697b516e118e22741c678 not found: ID does not exist" Jul 01 19:26:12.803114 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803061 2578 scope.go:117] "RemoveContainer" containerID="7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41" Jul 01 19:26:12.803277 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803262 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41"} err="failed to get container status \"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41\": rpc error: code = NotFound desc = could not find container \"7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41\": container with ID starting with 7e8db2a3b20d719c42ca77e801f265aa22f3f9891a10d00cfd377f0239cd0f41 not found: ID does not exist" Jul 01 19:26:12.803277 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803277 2578 scope.go:117] "RemoveContainer" containerID="f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9" Jul 01 19:26:12.803467 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803449 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9"} err="failed to get container status \"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9\": rpc error: code = NotFound desc = could not find container \"f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9\": container with ID starting with f4406074bdec6ba3982382d9560f4f5cd4f5b1ac124e844e762970d4f6886fd9 not found: ID does not exist" Jul 01 19:26:12.803507 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803468 2578 scope.go:117] "RemoveContainer" containerID="01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41" Jul 01 19:26:12.803674 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:12.803654 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41"} err="failed to get container status \"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41\": rpc error: code = NotFound desc = could not find container \"01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41\": container with ID starting with 01511dbd608284c17ae0fb24b0e6eff04e62bd579df1aedbdc02c4de9f801b41 not found: ID does not exist" Jul 01 19:26:13.888092 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:13.888054 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" path="/var/lib/kubelet/pods/f2d23233-70a2-44c3-8537-280f6bc4aae9/volumes" Jul 01 19:26:14.913939 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.913907 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:26:14.914316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.914192 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" gracePeriod=600 Jul 01 19:26:14.914316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.914239 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy" containerID="cri-o://36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" gracePeriod=600 Jul 01 19:26:14.914316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.914263 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="thanos-sidecar" containerID="cri-o://238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" gracePeriod=600 Jul 01 19:26:14.914316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.914270 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-web" containerID="cri-o://1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" gracePeriod=600 Jul 01 19:26:14.914316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.914185 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="prometheus" containerID="cri-o://cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" gracePeriod=600 Jul 01 19:26:14.914536 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:14.914270 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="config-reloader" containerID="cri-o://901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" gracePeriod=600 Jul 01 19:26:15.150483 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.150460 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.212648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212589 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-trusted-ca-bundle\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212625 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-2\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212645 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqzn2\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-kube-api-access-tqzn2\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212674 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-tls\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212699 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-web-config\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212729 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-0\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212765 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-db\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212793 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-tls-assets\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-metrics-client-certs\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.212885 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212858 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-thanos-prometheus-http-client-file\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212889 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-1\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212919 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-metrics-client-ca\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212950 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-kubelet-serving-ca-bundle\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212978 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-kube-rbac-proxy\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.212985 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213014 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-serving-certs-ca-bundle\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213017 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213063 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-config-out\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213099 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213146 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-grpc-tls\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213171 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-config\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213234 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213195 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b2de5427-5969-4425-8484-ecff425e2727\" (UID: \"b2de5427-5969-4425-8484-ecff425e2727\") " Jul 01 19:26:15.213831 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213380 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.213831 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213470 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.213831 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213489 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.213831 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213504 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-metrics-client-ca\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.213831 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.213802 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.214393 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.214331 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.214726 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.214701 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.215261 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.215225 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-kube-api-access-tqzn2" (OuterVolumeSpecName: "kube-api-access-tqzn2") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "kube-api-access-tqzn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:15.215482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.215458 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:26:15.215899 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.215877 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:15.216355 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.216032 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:15.216716 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.216686 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.216794 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.216759 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.216895 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.216864 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.217100 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.217070 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.217869 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.217844 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.217990 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.217873 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-config" (OuterVolumeSpecName: "config") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.218100 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.218070 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.218494 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.218474 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-config-out" (OuterVolumeSpecName: "config-out") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:26:15.219089 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.219069 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.227369 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.227346 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-web-config" (OuterVolumeSpecName: "web-config") pod "b2de5427-5969-4425-8484-ecff425e2727" (UID: "b2de5427-5969-4425-8484-ecff425e2727"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:15.314041 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314020 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-tls-assets\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314041 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314040 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-metrics-client-certs\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314050 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314060 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314070 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314078 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-kube-rbac-proxy\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314086 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314096 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-config-out\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314104 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314114 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-grpc-tls\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314122 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-config\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314130 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314138 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqzn2\" (UniqueName: \"kubernetes.io/projected/b2de5427-5969-4425-8484-ecff425e2727-kube-api-access-tqzn2\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314146 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314152 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314153 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2de5427-5969-4425-8484-ecff425e2727-web-config\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314538 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314162 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.314538 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.314169 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2de5427-5969-4425-8484-ecff425e2727-prometheus-k8s-db\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:26:15.767698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767667 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" exitCode=0 Jul 01 19:26:15.767698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767691 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" exitCode=0 Jul 01 19:26:15.767698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767698 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" exitCode=0 Jul 01 19:26:15.767698 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767704 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" exitCode=0 Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767710 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" exitCode=0 Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767715 2578 generic.go:356] "Generic (PLEG): container finished" podID="b2de5427-5969-4425-8484-ecff425e2727" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" exitCode=0 Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767748 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767841 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767881 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} Jul 01 19:26:15.768008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.767938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2de5427-5969-4425-8484-ecff425e2727","Type":"ContainerDied","Data":"c2e37dac931c94a5669db74cebf68373ba2810ab0d6c3b407632f10af34a3eb6"} Jul 01 19:26:15.775317 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.775128 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.781560 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.781545 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.787901 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.787885 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.792756 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.792734 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:26:15.794756 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.794739 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.798660 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.798641 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:26:15.801416 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.801397 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.808077 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.808044 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.818658 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.818614 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.819060 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.819007 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.819268 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.819200 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} err="failed to get container status \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" Jul 01 19:26:15.819351 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.819279 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.819650 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.819606 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.819694 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.819665 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} err="failed to get container status \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" Jul 01 19:26:15.819734 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.819696 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.819972 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.819956 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.820010 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.819976 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} err="failed to get container status \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" Jul 01 19:26:15.820010 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.819990 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.820274 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.820257 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.820350 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.820275 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} err="failed to get container status \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" Jul 01 19:26:15.820350 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.820295 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.820565 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.820531 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.820601 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.820579 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} err="failed to get container status \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" Jul 01 19:26:15.820637 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.820609 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.820948 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.820927 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.820997 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.820958 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} err="failed to get container status \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" Jul 01 19:26:15.820997 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.820984 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.821317 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:26:15.821279 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.821365 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.821339 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} err="failed to get container status \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" Jul 01 19:26:15.821411 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.821370 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.821648 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.821630 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} err="failed to get container status \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" Jul 01 19:26:15.821690 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.821649 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.821849 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.821833 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} err="failed to get container status \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" Jul 01 19:26:15.821903 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.821849 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.822071 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822053 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} err="failed to get container status \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" Jul 01 19:26:15.822131 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822074 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.822340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822318 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} err="failed to get container status \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" Jul 01 19:26:15.822340 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822338 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.822577 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822559 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} err="failed to get container status \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" Jul 01 19:26:15.822577 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822577 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.822763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822747 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} err="failed to get container status \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" Jul 01 19:26:15.822805 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822764 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.822932 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822917 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} err="failed to get container status \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" Jul 01 19:26:15.822974 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.822933 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.823101 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823087 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} err="failed to get container status \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" Jul 01 19:26:15.823142 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823102 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.823318 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823302 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} err="failed to get container status \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" Jul 01 19:26:15.823371 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823318 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.823487 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823472 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} err="failed to get container status \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" Jul 01 19:26:15.823526 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823487 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.823671 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823656 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} err="failed to get container status \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" Jul 01 19:26:15.823709 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823671 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.823841 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823827 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} err="failed to get container status \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" Jul 01 19:26:15.823882 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.823842 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.824055 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824038 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} err="failed to get container status \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" Jul 01 19:26:15.824102 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824054 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.824265 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824250 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} err="failed to get container status \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" Jul 01 19:26:15.824311 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824266 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.824452 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824438 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} err="failed to get container status \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" Jul 01 19:26:15.824498 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824452 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.824632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824612 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} err="failed to get container status \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" Jul 01 19:26:15.824673 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824633 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.824812 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824797 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} err="failed to get container status \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" Jul 01 19:26:15.824854 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824811 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.824985 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824964 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} err="failed to get container status \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" Jul 01 19:26:15.825026 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.824986 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.825159 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825145 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} err="failed to get container status \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" Jul 01 19:26:15.825195 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825159 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.825370 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825356 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} err="failed to get container status \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" Jul 01 19:26:15.825370 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825370 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.825546 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825532 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} err="failed to get container status \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" Jul 01 19:26:15.825586 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825546 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.825702 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825686 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} err="failed to get container status \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" Jul 01 19:26:15.825742 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825703 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.825881 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825864 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} err="failed to get container status \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" Jul 01 19:26:15.825881 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.825881 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.826058 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826042 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} err="failed to get container status \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" Jul 01 19:26:15.826096 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826060 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.826264 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826243 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} err="failed to get container status \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" Jul 01 19:26:15.826343 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826267 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.826457 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826440 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} err="failed to get container status \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" Jul 01 19:26:15.826526 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826458 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.826943 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826729 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} err="failed to get container status \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" Jul 01 19:26:15.826943 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.826788 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.827535 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.827462 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} err="failed to get container status \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" Jul 01 19:26:15.827535 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.827490 2578 scope.go:117] "RemoveContainer" containerID="7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1" Jul 01 19:26:15.828224 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828174 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1"} err="failed to get container status \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": rpc error: code = NotFound desc = could not find container \"7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1\": container with ID starting with 7dda20510ecc741a99a761e3f9bc9a978121eb476beae60ba4b17a9fbc3d3aa1 not found: ID does not exist" Jul 01 19:26:15.828314 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828224 2578 scope.go:117] "RemoveContainer" containerID="36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51" Jul 01 19:26:15.828463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828445 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51"} err="failed to get container status \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": rpc error: code = NotFound desc = could not find container \"36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51\": container with ID starting with 36e1f881e628ae4140a04b17dd9352ff90f221940b9b54fdc32397257d11fd51 not found: ID does not exist" Jul 01 19:26:15.828511 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828464 2578 scope.go:117] "RemoveContainer" containerID="1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1" Jul 01 19:26:15.828685 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828670 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1"} err="failed to get container status \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": rpc error: code = NotFound desc = could not find container \"1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1\": container with ID starting with 1469d9e768a5949cb887f407cc5787531484e5ec300a5091a11803b4b83663e1 not found: ID does not exist" Jul 01 19:26:15.828732 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828684 2578 scope.go:117] "RemoveContainer" containerID="238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d" Jul 01 19:26:15.828868 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828853 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d"} err="failed to get container status \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": rpc error: code = NotFound desc = could not find container \"238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d\": container with ID starting with 238237fcb3a172258d7e2ac50bda7921fc8030d062caf9b554cf77cf59ee141d not found: ID does not exist" Jul 01 19:26:15.828868 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.828866 2578 scope.go:117] "RemoveContainer" containerID="901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339" Jul 01 19:26:15.829072 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829055 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:26:15.829119 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829067 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339"} err="failed to get container status \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": rpc error: code = NotFound desc = could not find container \"901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339\": container with ID starting with 901ba3e36c3f4d983bd26d6a055be112f937b317e2d4e81e17d76298404bc339 not found: ID does not exist" Jul 01 19:26:15.829119 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829081 2578 scope.go:117] "RemoveContainer" containerID="cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697" Jul 01 19:26:15.829301 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829283 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697"} err="failed to get container status \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": rpc error: code = NotFound desc = could not find container \"cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697\": container with ID starting with cf57e89489d6b39b44ab5d0bd3baa11906078a31ede16e4aef17927add835697 not found: ID does not exist" Jul 01 19:26:15.829352 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829302 2578 scope.go:117] "RemoveContainer" containerID="d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7" Jul 01 19:26:15.829382 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829349 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy" Jul 01 19:26:15.829382 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829364 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy" Jul 01 19:26:15.829382 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829377 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99d73e84-2a7a-4de0-abb5-9946b56173fd" containerName="console" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829386 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="99d73e84-2a7a-4de0-abb5-9946b56173fd" containerName="console" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829401 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="init-config-reloader" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829410 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="init-config-reloader" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829422 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="init-config-reloader" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829430 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="init-config-reloader" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829439 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="alertmanager" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829446 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="alertmanager" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829455 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829463 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829474 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-metric" Jul 01 19:26:15.829482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829483 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-metric" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829489 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="prometheus" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829494 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="prometheus" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829504 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="config-reloader" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829509 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="config-reloader" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829514 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-thanos" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829519 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-thanos" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829516 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7"} err="failed to get container status \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": rpc error: code = NotFound desc = could not find container \"d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7\": container with ID starting with d21822a5bcbe244433536b5ceebed15b1b5e06cd0e3dcaeb540786b008b6f6b7 not found: ID does not exist" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829526 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="config-reloader" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829532 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="config-reloader" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829537 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-web" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829542 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-web" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829547 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-web" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829552 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-web" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829559 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="thanos-sidecar" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829564 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="thanos-sidecar" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829572 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="prom-label-proxy" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829578 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="prom-label-proxy" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829625 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-web" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829632 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="prom-label-proxy" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829638 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy-thanos" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829644 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="thanos-sidecar" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829649 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-web" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829654 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy-metric" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829659 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="config-reloader" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829663 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="kube-rbac-proxy" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829669 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="99d73e84-2a7a-4de0-abb5-9946b56173fd" containerName="console" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829674 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2de5427-5969-4425-8484-ecff425e2727" containerName="prometheus" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829679 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="alertmanager" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829683 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="config-reloader" Jul 01 19:26:15.829792 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.829688 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d23233-70a2-44c3-8537-280f6bc4aae9" containerName="kube-rbac-proxy" Jul 01 19:26:15.832981 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.832967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.838012 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.837993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 19:26:15.838260 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.838242 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 19:26:15.838344 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.838316 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 19:26:15.838406 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.838355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 19:26:15.839434 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.839414 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 19:26:15.839608 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.839591 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 19:26:15.839706 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.839693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:26:15.840137 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840121 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 19:26:15.840299 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840283 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 19:26:15.840353 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 19:26:15.840647 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 19:26:15.840724 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 19:26:15.840858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840844 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-njdpp\"" Jul 01 19:26:15.840915 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.840894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 19:26:15.841731 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.841716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9s4bkl4p5f6gq\"" Jul 01 19:26:15.842596 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.842572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 19:26:15.848125 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.848108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 19:26:15.852636 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.852617 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:26:15.888678 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.888652 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2de5427-5969-4425-8484-ecff425e2727" path="/var/lib/kubelet/pods/b2de5427-5969-4425-8484-ecff425e2727/volumes" Jul 01 19:26:15.918681 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d994c8e-3b8d-4202-b887-ff1e6a593da6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d994c8e-3b8d-4202-b887-ff1e6a593da6-config-out\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.918982 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.918995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-config\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-web-config\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbfb5\" (UniqueName: \"kubernetes.io/projected/9d994c8e-3b8d-4202-b887-ff1e6a593da6-kube-api-access-vbfb5\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:15.919294 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:15.919155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020459 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020459 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d994c8e-3b8d-4202-b887-ff1e6a593da6-config-out\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020459 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-config\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-web-config\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbfb5\" (UniqueName: \"kubernetes.io/projected/9d994c8e-3b8d-4202-b887-ff1e6a593da6-kube-api-access-vbfb5\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d994c8e-3b8d-4202-b887-ff1e6a593da6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.020991 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.020941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.021497 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.021374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.022316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.021571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.022316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.021987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.023244 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.022559 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.024278 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.023395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.024278 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.023715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.024278 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.024175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.024278 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.024249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025026 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.024480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9d994c8e-3b8d-4202-b887-ff1e6a593da6-config-out\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025026 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.024569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025026 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.024641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025372 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.025344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9d994c8e-3b8d-4202-b887-ff1e6a593da6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025430 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.025356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025479 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.025432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025685 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.025663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.025766 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.025730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9d994c8e-3b8d-4202-b887-ff1e6a593da6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.026248 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.026202 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-web-config\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.026824 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.026797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.027125 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.027109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d994c8e-3b8d-4202-b887-ff1e6a593da6-config\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.031036 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.031019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbfb5\" (UniqueName: \"kubernetes.io/projected/9d994c8e-3b8d-4202-b887-ff1e6a593da6-kube-api-access-vbfb5\") pod \"prometheus-k8s-0\" (UID: \"9d994c8e-3b8d-4202-b887-ff1e6a593da6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.142352 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.142322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:16.280609 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.280585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 19:26:16.281738 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:26:16.281718 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d994c8e_3b8d_4202_b887_ff1e6a593da6.slice/crio-7f759a5482379ea262910fd5b81f96a209d59822cab555b4eaea4bea0226f450 WatchSource:0}: Error finding container 7f759a5482379ea262910fd5b81f96a209d59822cab555b4eaea4bea0226f450: Status 404 returned error can't find the container with id 7f759a5482379ea262910fd5b81f96a209d59822cab555b4eaea4bea0226f450 Jul 01 19:26:16.773390 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.773358 2578 generic.go:356] "Generic (PLEG): container finished" podID="9d994c8e-3b8d-4202-b887-ff1e6a593da6" containerID="3b511a4f3456f64b90dfc22e727d4d2e88c6be112c11fd510cbc26d4f221e164" exitCode=0 Jul 01 19:26:16.773565 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.773420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerDied","Data":"3b511a4f3456f64b90dfc22e727d4d2e88c6be112c11fd510cbc26d4f221e164"} Jul 01 19:26:16.773565 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:16.773469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"7f759a5482379ea262910fd5b81f96a209d59822cab555b4eaea4bea0226f450"} Jul 01 19:26:17.781066 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.781028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"59def7e35fae7dc1d127cb9bbb380031c3700c9bb4b06fde3670ee7c2cb998b7"} Jul 01 19:26:17.781443 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.781121 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"6467028592a5b2e37b48a3966d3dc2f0a5eae43aa920b84fdb8a2b713471ba64"} Jul 01 19:26:17.781443 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.781146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"3df95b58b9740da6438ce333adc226d6e354d0805fed0bd599ab2417a8d7a91c"} Jul 01 19:26:17.781443 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.781173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"b0f662ee277c7a009aab92c6c161b881f1b9597f8255be9cec1c956c3e4bf98f"} Jul 01 19:26:17.781443 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.781199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"d943a387564c728e040c2ee2aeea8928aa522ca492d2a5ca3d92d9780eb26cb4"} Jul 01 19:26:17.781443 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.781236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9d994c8e-3b8d-4202-b887-ff1e6a593da6","Type":"ContainerStarted","Data":"6e49afb99d8be4f14088d7a9f15c1be289fa9896e3f6b5ed681e3687a326705c"} Jul 01 19:26:17.813621 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:17.813553 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7944168 podStartE2EDuration="2.813533583s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.116783ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:17.812529327 +0000 UTC m=+206.392208087" watchObservedRunningTime="2026-07-01 19:26:17.813533583 +0000 UTC m=+206.393212342" Jul 01 19:26:18.068321 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:18.068252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:18.146582 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:18.146554 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:21.062297 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:21.062269 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:21.142928 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:21.142902 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:26:21.160815 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:21.160790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:21.574759 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:21.574729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:21.637083 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:21.637057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:49.732117 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:49.732083 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:49.832915 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:49.832877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:50.758624 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:50.758591 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:53.965379 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:53.965347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:54.064258 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:54.064228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:54.310571 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:54.310495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:54.402697 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:54.402660 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:54.516841 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:54.516818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:26:59.172034 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:26:59.172004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:14.306221 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:14.306130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:16.143090 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:16.143058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:27:16.158201 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:16.158176 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:27:16.544193 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:16.544157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:16.733015 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:16.732984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:17.008199 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:17.008172 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 19:27:23.120689 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:23.120659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:23.409667 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:23.409587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:23.622503 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:23.622464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:23.786482 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:23.786452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:24.129008 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:24.128924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:24.502649 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:24.502602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:24.638856 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:24.638827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:24.737170 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:24.737136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:25.377080 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:25.377044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:25.645145 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:25.645056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:25.855620 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:25.855580 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:26.201686 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:26.201650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:27:51.823271 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:51.823238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:27:51.826409 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:51.826383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:27:51.827571 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:51.827547 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:27:51.830782 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:51.830759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:27:51.832283 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:51.832267 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:27:55.573284 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:27:55.573251 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:26.699108 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:26.699074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:28.348835 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:28.348802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:30.808414 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:30.808383 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:30.917254 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:30.917201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:31.037295 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:31.037265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:31.127821 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:31.127751 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:31.555561 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:31.555533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:31.666354 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:31.666327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:28:31.760322 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:28:31.760289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:41.787819 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:29:41.787785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:41.890248 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:29:41.890216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:42.160917 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:29:42.160841 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:42.251114 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:29:42.251089 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:42.793375 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:29:42.793334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:29:42.898634 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:29:42.898601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:05.910601 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:05.910566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:06.009009 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:06.008959 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:20.742017 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.741942 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648996b69f-28226"] Jul 01 19:30:20.745114 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.745093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.760244 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:30:20.760530 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760512 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:30:20.760583 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760516 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:30:20.760583 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760543 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:30:20.760858 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760841 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:30:20.760924 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760861 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vq2mg\"" Jul 01 19:30:20.760924 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760875 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:30:20.760924 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.760864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:30:20.764437 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.764420 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:30:20.775274 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.775256 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648996b69f-28226"] Jul 01 19:30:20.867154 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.867126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:20.938909 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.938884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-oauth-serving-cert\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.939005 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.938926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-service-ca\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.939005 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.938951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc65a300-615e-41ad-bad9-3188e655ca6b-console-oauth-config\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.939005 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.938990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvb9h\" (UniqueName: \"kubernetes.io/projected/bc65a300-615e-41ad-bad9-3188e655ca6b-kube-api-access-bvb9h\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.939111 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.939035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-console-config\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.939111 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.939055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-trusted-ca-bundle\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.939111 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.939081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc65a300-615e-41ad-bad9-3188e655ca6b-console-serving-cert\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:20.940173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:20.940151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:21.039894 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc65a300-615e-41ad-bad9-3188e655ca6b-console-serving-cert\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.039894 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-oauth-serving-cert\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040039 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-service-ca\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040039 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc65a300-615e-41ad-bad9-3188e655ca6b-console-oauth-config\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040039 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvb9h\" (UniqueName: \"kubernetes.io/projected/bc65a300-615e-41ad-bad9-3188e655ca6b-kube-api-access-bvb9h\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040039 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-console-config\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040039 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.039990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-trusted-ca-bundle\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040662 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.040640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-console-config\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040760 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.040663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-oauth-serving-cert\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040807 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.040770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-trusted-ca-bundle\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.040874 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.040854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc65a300-615e-41ad-bad9-3188e655ca6b-service-ca\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.042415 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.042394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc65a300-615e-41ad-bad9-3188e655ca6b-console-oauth-config\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.042494 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.042431 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc65a300-615e-41ad-bad9-3188e655ca6b-console-serving-cert\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.049553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.049530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvb9h\" (UniqueName: \"kubernetes.io/projected/bc65a300-615e-41ad-bad9-3188e655ca6b-kube-api-access-bvb9h\") pod \"console-648996b69f-28226\" (UID: \"bc65a300-615e-41ad-bad9-3188e655ca6b\") " pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.054393 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.054377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:21.185068 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.185046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648996b69f-28226"] Jul 01 19:30:21.187068 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:30:21.187045 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc65a300_615e_41ad_bad9_3188e655ca6b.slice/crio-ed4df62fb31b8a40a87c1f941dd43f8daa494c244a1923f3a350696969c50b44 WatchSource:0}: Error finding container ed4df62fb31b8a40a87c1f941dd43f8daa494c244a1923f3a350696969c50b44: Status 404 returned error can't find the container with id ed4df62fb31b8a40a87c1f941dd43f8daa494c244a1923f3a350696969c50b44 Jul 01 19:30:21.639351 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.639312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648996b69f-28226" event={"ID":"bc65a300-615e-41ad-bad9-3188e655ca6b","Type":"ContainerStarted","Data":"7d6aebcdd85cb75701b01d5deb5758026eac9e6c030e40447bc741f14d79ea89"} Jul 01 19:30:21.639524 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.639392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648996b69f-28226" event={"ID":"bc65a300-615e-41ad-bad9-3188e655ca6b","Type":"ContainerStarted","Data":"ed4df62fb31b8a40a87c1f941dd43f8daa494c244a1923f3a350696969c50b44"} Jul 01 19:30:21.669281 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:21.669232 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648996b69f-28226" podStartSLOduration=1.6692181289999999 podStartE2EDuration="1.669218129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:21.668313406 +0000 UTC m=+450.247992165" watchObservedRunningTime="2026-07-01 19:30:21.669218129 +0000 UTC m=+450.248896879" Jul 01 19:30:31.054996 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:31.054962 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:31.055440 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:31.055049 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:31.060028 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:31.060006 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:31.678097 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:31.678069 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648996b69f-28226" Jul 01 19:30:32.036220 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:32.036179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:30:32.173363 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:30:32.173331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:31:17.972965 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:31:17.972932 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:07.102073 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:07.101992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:07.295488 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:07.295452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:19.940526 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:19.940489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:20.041424 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:20.041389 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:31.138891 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:31.138857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:31.601047 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:31.601012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:32:51.848677 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:51.848648 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:32:51.850093 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:51.850069 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:32:51.853123 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:51.853094 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:32:51.854531 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:32:51.854512 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:34:16.363165 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:34:16.363136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:18.541250 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:34:18.541192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:25.223361 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:34:25.223315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:31.359572 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:34:31.359541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:40.117412 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:34:40.117373 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:34:40.218271 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:34:40.218240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:35:16.874399 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:35:16.874314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:35:51.553533 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:35:51.553497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:35:51.638723 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:35:51.638683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:35:51.775580 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:35:51.775545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:11.597572 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:36:11.597535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:36:12.021351 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:36:12.021318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:37:46.924577 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:46.924536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:37:46.997032 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:46.996996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:37:47.087046 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:47.087007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:37:51.871367 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:51.871339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:37:51.871791 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:51.871481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:37:51.875741 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:51.875719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:37:51.876102 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:37:51.876085 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:39:30.628072 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:39:30.628019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:39:41.124085 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:39:41.124050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:40:47.136862 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:40:47.136782 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:40:52.313037 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:40:52.313003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:40:52.578038 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:40:52.577958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:23.172831 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:23.172746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:23.262553 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:23.262517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:42.649682 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:42.649638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:43.305001 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:43.304956 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:47.652533 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:47.652499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:47.769936 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:47.769827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:42:51.893850 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:51.893826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:42:51.895055 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:51.895034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:42:51.898392 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:51.898376 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:42:51.899305 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:42:51.899290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:44:57.898654 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:44:57.898616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:45:02.942549 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:45:02.942519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:45:03.111778 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:45:03.111743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:12.606313 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:46:12.606279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:53.155005 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:46:53.154929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:58.261025 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:46:58.260992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:46:58.688022 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:46:58.687926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:47:28.431929 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:28.431890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:47:34.337888 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.337858 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4ljz2/must-gather-bgqg5"] Jul 01 19:47:34.340988 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.340971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.343735 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.343716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4ljz2\"/\"default-dockercfg-k2nth\"" Jul 01 19:47:34.344646 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.344628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4ljz2\"/\"kube-root-ca.crt\"" Jul 01 19:47:34.344736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.344670 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4ljz2\"/\"openshift-service-ca.crt\"" Jul 01 19:47:34.355061 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.355038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4ljz2/must-gather-bgqg5"] Jul 01 19:47:34.387079 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.387052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:47:34.460360 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.460330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:47:34.504505 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.504475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7282a470-1ee6-4d6d-9adf-93ed732458b1-must-gather-output\") pod \"must-gather-bgqg5\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.504632 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.504529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd2f9\" (UniqueName: \"kubernetes.io/projected/7282a470-1ee6-4d6d-9adf-93ed732458b1-kube-api-access-jd2f9\") pod \"must-gather-bgqg5\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.605049 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.604959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7282a470-1ee6-4d6d-9adf-93ed732458b1-must-gather-output\") pod \"must-gather-bgqg5\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.605049 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.605033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd2f9\" (UniqueName: \"kubernetes.io/projected/7282a470-1ee6-4d6d-9adf-93ed732458b1-kube-api-access-jd2f9\") pod \"must-gather-bgqg5\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.605333 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.605312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7282a470-1ee6-4d6d-9adf-93ed732458b1-must-gather-output\") pod \"must-gather-bgqg5\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.615093 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.615073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd2f9\" (UniqueName: \"kubernetes.io/projected/7282a470-1ee6-4d6d-9adf-93ed732458b1-kube-api-access-jd2f9\") pod \"must-gather-bgqg5\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.665117 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.665084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:47:34.790137 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.790113 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4ljz2/must-gather-bgqg5"] Jul 01 19:47:34.792572 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:47:34.792545 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7282a470_1ee6_4d6d_9adf_93ed732458b1.slice/crio-4af33ef90838e184fdc6de16db28c9bcd3daac459d7571fabdfbf8b243409214 WatchSource:0}: Error finding container 4af33ef90838e184fdc6de16db28c9bcd3daac459d7571fabdfbf8b243409214: Status 404 returned error can't find the container with id 4af33ef90838e184fdc6de16db28c9bcd3daac459d7571fabdfbf8b243409214 Jul 01 19:47:34.794424 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:34.794407 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:47:35.320422 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:35.320383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" event={"ID":"7282a470-1ee6-4d6d-9adf-93ed732458b1","Type":"ContainerStarted","Data":"4af33ef90838e184fdc6de16db28c9bcd3daac459d7571fabdfbf8b243409214"} Jul 01 19:47:41.347895 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:41.347858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" event={"ID":"7282a470-1ee6-4d6d-9adf-93ed732458b1","Type":"ContainerStarted","Data":"1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8"} Jul 01 19:47:41.347895 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:41.347903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" event={"ID":"7282a470-1ee6-4d6d-9adf-93ed732458b1","Type":"ContainerStarted","Data":"799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa"} Jul 01 19:47:41.366797 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:41.366748 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" podStartSLOduration=1.419695795 podStartE2EDuration="7.366733296s" totalImagesPullingTime="5.947037501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:47:41.365376532 +0000 UTC m=+1489.945055292" watchObservedRunningTime="2026-07-01 19:47:41.366733296 +0000 UTC m=+1489.946412054" Jul 01 19:47:51.927133 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:51.927099 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:47:51.928092 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:51.928066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:47:51.931700 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:51.931681 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:47:51.932642 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:47:51.932622 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:48:02.437738 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:02.437706 2578 generic.go:356] "Generic (PLEG): container finished" podID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerID="799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa" exitCode=0 Jul 01 19:48:02.438173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:02.437778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" event={"ID":"7282a470-1ee6-4d6d-9adf-93ed732458b1","Type":"ContainerDied","Data":"799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa"} Jul 01 19:48:02.438173 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:02.438091 2578 scope.go:117] "RemoveContainer" containerID="799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa" Jul 01 19:48:02.486375 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:02.486346 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4ljz2_must-gather-bgqg5_7282a470-1ee6-4d6d-9adf-93ed732458b1/gather/0.log" Jul 01 19:48:02.884270 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:02.884236 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:03.041602 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:03.041573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:03.135095 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:03.135019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:05.756791 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:05.756763 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-flz5h_79bfe935-9410-4436-b3ca-a12a8991782d/global-pull-secret-syncer/0.log" Jul 01 19:48:05.928887 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:05.928857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" Jul 01 19:48:06.055931 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:06.055858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-159.ec2.internal_74636d215efc6b6c19362ef99095583b/haproxy/0.log" Jul 01 19:48:07.878133 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:07.878097 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4ljz2/must-gather-bgqg5"] Jul 01 19:48:07.878542 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:07.878332 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="copy" containerID="cri-o://1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8" gracePeriod=2 Jul 01 19:48:07.890454 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:07.890431 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4ljz2/must-gather-bgqg5"] Jul 01 19:48:08.104468 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.104446 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4ljz2_must-gather-bgqg5_7282a470-1ee6-4d6d-9adf-93ed732458b1/copy/0.log" Jul 01 19:48:08.106339 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.106322 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:48:08.108724 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:48:08.108700 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bgqg5\" is forbidden: User \"system:node:ip-10-0-133-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4ljz2\": no relationship found between node 'ip-10-0-133-159.ec2.internal' and this object" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:48:08.189654 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.189566 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7282a470-1ee6-4d6d-9adf-93ed732458b1-must-gather-output\") pod \"7282a470-1ee6-4d6d-9adf-93ed732458b1\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " Jul 01 19:48:08.189814 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.189660 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd2f9\" (UniqueName: \"kubernetes.io/projected/7282a470-1ee6-4d6d-9adf-93ed732458b1-kube-api-access-jd2f9\") pod \"7282a470-1ee6-4d6d-9adf-93ed732458b1\" (UID: \"7282a470-1ee6-4d6d-9adf-93ed732458b1\") " Jul 01 19:48:08.191006 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.190976 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7282a470-1ee6-4d6d-9adf-93ed732458b1-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "7282a470-1ee6-4d6d-9adf-93ed732458b1" (UID: "7282a470-1ee6-4d6d-9adf-93ed732458b1"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:48:08.191843 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.191821 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7282a470-1ee6-4d6d-9adf-93ed732458b1-kube-api-access-jd2f9" (OuterVolumeSpecName: "kube-api-access-jd2f9") pod "7282a470-1ee6-4d6d-9adf-93ed732458b1" (UID: "7282a470-1ee6-4d6d-9adf-93ed732458b1"). InnerVolumeSpecName "kube-api-access-jd2f9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:48:08.290456 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.290421 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7282a470-1ee6-4d6d-9adf-93ed732458b1-must-gather-output\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:48:08.290456 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.290450 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd2f9\" (UniqueName: \"kubernetes.io/projected/7282a470-1ee6-4d6d-9adf-93ed732458b1-kube-api-access-jd2f9\") on node \"ip-10-0-133-159.ec2.internal\" DevicePath \"\"" Jul 01 19:48:08.461367 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.461291 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4ljz2_must-gather-bgqg5_7282a470-1ee6-4d6d-9adf-93ed732458b1/copy/0.log" Jul 01 19:48:08.461661 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.461637 2578 generic.go:356] "Generic (PLEG): container finished" podID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerID="1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8" exitCode=143 Jul 01 19:48:08.461758 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.461683 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:48:08.461758 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.461743 2578 scope.go:117] "RemoveContainer" containerID="1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8" Jul 01 19:48:08.464045 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:48:08.464009 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bgqg5\" is forbidden: User \"system:node:ip-10-0-133-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4ljz2\": no relationship found between node 'ip-10-0-133-159.ec2.internal' and this object" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:48:08.469399 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.469375 2578 scope.go:117] "RemoveContainer" containerID="799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa" Jul 01 19:48:08.472077 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:48:08.472050 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bgqg5\" is forbidden: User \"system:node:ip-10-0-133-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4ljz2\": no relationship found between node 'ip-10-0-133-159.ec2.internal' and this object" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" pod="openshift-must-gather-4ljz2/must-gather-bgqg5" Jul 01 19:48:08.479992 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.479971 2578 scope.go:117] "RemoveContainer" containerID="1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8" Jul 01 19:48:08.480258 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:48:08.480238 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8\": container with ID starting with 1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8 not found: ID does not exist" containerID="1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8" Jul 01 19:48:08.480307 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.480266 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8"} err="failed to get container status \"1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8\": rpc error: code = NotFound desc = could not find container \"1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8\": container with ID starting with 1a0c69bfc6107e8cea62a43833fce9f95cf0dce835231c605f16a3eff1836ca8 not found: ID does not exist" Jul 01 19:48:08.480307 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.480283 2578 scope.go:117] "RemoveContainer" containerID="799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa" Jul 01 19:48:08.480478 ip-10-0-133-159 kubenswrapper[2578]: E0701 19:48:08.480463 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa\": container with ID starting with 799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa not found: ID does not exist" containerID="799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa" Jul 01 19:48:08.480519 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:08.480482 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa"} err="failed to get container status \"799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa\": rpc error: code = NotFound desc = could not find container \"799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa\": container with ID starting with 799b2a260430d65abfa5a051fa2e18f1b4ed42a463bba20f9a2c1cc9335addaa not found: ID does not exist" Jul 01 19:48:09.129243 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:09.129185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:09.205056 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:09.205027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-99mzn_0c618b5a-b544-40a2-aa45-752234dcfe64/konnectivity-agent/0.log" limit=1024 Jul 01 19:48:09.888756 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:09.888726 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" path="/var/lib/kubelet/pods/7282a470-1ee6-4d6d-9adf-93ed732458b1/volumes" Jul 01 19:48:10.482028 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:10.481996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-fmll8_9f061c92-8071-4b8a-aa13-daf169b68882/kube-state-metrics/0.log" Jul 01 19:48:10.518888 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:10.518862 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-fmll8_9f061c92-8071-4b8a-aa13-daf169b68882/kube-rbac-proxy-main/0.log" Jul 01 19:48:10.547706 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:10.547680 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-fmll8_9f061c92-8071-4b8a-aa13-daf169b68882/kube-rbac-proxy-self/0.log" Jul 01 19:48:10.620736 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:10.620710 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-l65cl_0e6d5fe6-c38a-47fe-a4ef-d9e6e4f26c48/monitoring-plugin/0.log" Jul 01 19:48:10.938906 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:10.938881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m67rx_f67a155c-abee-487e-802c-963c7dd3d476/node-exporter/0.log" Jul 01 19:48:10.981808 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:10.981784 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m67rx_f67a155c-abee-487e-802c-963c7dd3d476/kube-rbac-proxy/0.log" Jul 01 19:48:11.019001 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.018976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m67rx_f67a155c-abee-487e-802c-963c7dd3d476/init-textfile/0.log" Jul 01 19:48:11.160932 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.160895 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/prometheus/0.log" Jul 01 19:48:11.195845 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.195781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/config-reloader/0.log" Jul 01 19:48:11.244851 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.244831 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/thanos-sidecar/0.log" Jul 01 19:48:11.287645 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.287625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/kube-rbac-proxy-web/0.log" Jul 01 19:48:11.340064 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.340045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/kube-rbac-proxy/0.log" Jul 01 19:48:11.376364 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.376327 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/kube-rbac-proxy-thanos/0.log" Jul 01 19:48:11.412564 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:11.412543 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9d994c8e-3b8d-4202-b887-ff1e6a593da6/init-config-reloader/0.log" Jul 01 19:48:13.363882 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.363811 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/1.log" Jul 01 19:48:13.369304 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.369284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4n62t_bafb77da-2ae1-4563-9e7a-b08997f67e2a/console-operator/2.log" Jul 01 19:48:13.477674 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.477645 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2"] Jul 01 19:48:13.477999 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.477985 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="copy" Jul 01 19:48:13.478088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.478001 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="copy" Jul 01 19:48:13.478088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.478019 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="gather" Jul 01 19:48:13.478088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.478024 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="gather" Jul 01 19:48:13.478088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.478078 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="copy" Jul 01 19:48:13.478088 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.478087 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7282a470-1ee6-4d6d-9adf-93ed732458b1" containerName="gather" Jul 01 19:48:13.481898 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.481875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.485010 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.484984 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26hz8\"/\"default-dockercfg-9bjq5\"" Jul 01 19:48:13.485108 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.485022 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26hz8\"/\"kube-root-ca.crt\"" Jul 01 19:48:13.486055 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.486039 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26hz8\"/\"openshift-service-ca.crt\"" Jul 01 19:48:13.497852 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.497829 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2"] Jul 01 19:48:13.535044 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.535014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-sys\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.535185 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.535063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-podres\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.535185 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.535090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-lib-modules\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.535185 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.535147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-proc\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.535316 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.535237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrd5z\" (UniqueName: \"kubernetes.io/projected/7e242a89-8d01-48aa-b885-dfa12e142767-kube-api-access-rrd5z\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636250 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd5z\" (UniqueName: \"kubernetes.io/projected/7e242a89-8d01-48aa-b885-dfa12e142767-kube-api-access-rrd5z\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636250 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-sys\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-podres\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-lib-modules\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-proc\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-sys\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-proc\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636410 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-podres\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.636463 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.636419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e242a89-8d01-48aa-b885-dfa12e142767-lib-modules\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.645102 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.645067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrd5z\" (UniqueName: \"kubernetes.io/projected/7e242a89-8d01-48aa-b885-dfa12e142767-kube-api-access-rrd5z\") pod \"perf-node-gather-daemonset-sm9j2\" (UID: \"7e242a89-8d01-48aa-b885-dfa12e142767\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.791763 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.791724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:13.855668 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.855642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-648996b69f-28226_bc65a300-615e-41ad-bad9-3188e655ca6b/console/0.log" Jul 01 19:48:13.934869 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:13.934733 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2"] Jul 01 19:48:13.937364 ip-10-0-133-159 kubenswrapper[2578]: W0701 19:48:13.937325 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e242a89_8d01_48aa_b885_dfa12e142767.slice/crio-7910149503c9c9ac6071f307a0f159a753ac6585edcff6c4b6af888e59df01cf WatchSource:0}: Error finding container 7910149503c9c9ac6071f307a0f159a753ac6585edcff6c4b6af888e59df01cf: Status 404 returned error can't find the container with id 7910149503c9c9ac6071f307a0f159a753ac6585edcff6c4b6af888e59df01cf Jul 01 19:48:14.486302 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:14.486266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" event={"ID":"7e242a89-8d01-48aa-b885-dfa12e142767","Type":"ContainerStarted","Data":"e7d12708fa23847f68e75b6878a259b546ce2bae5b8fa3a5b7f4f90a478cc886"} Jul 01 19:48:14.486703 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:14.486319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" event={"ID":"7e242a89-8d01-48aa-b885-dfa12e142767","Type":"ContainerStarted","Data":"7910149503c9c9ac6071f307a0f159a753ac6585edcff6c4b6af888e59df01cf"} Jul 01 19:48:14.486703 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:14.486384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:14.504551 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:14.504503 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" podStartSLOduration=1.504487731 podStartE2EDuration="1.504487731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:14.503862757 +0000 UTC m=+1523.083541517" watchObservedRunningTime="2026-07-01 19:48:14.504487731 +0000 UTC m=+1523.084166489" Jul 01 19:48:15.505921 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:15.505889 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4whx_99d44382-6b98-4042-8601-6ebb97326b2b/dns/0.log" Jul 01 19:48:15.539102 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:15.539067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4whx_99d44382-6b98-4042-8601-6ebb97326b2b/kube-rbac-proxy/0.log" Jul 01 19:48:15.568500 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:15.568477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6s7s_193fbd87-c73c-4148-99a2-4abf6667a86f/dns-node-resolver/0.log" Jul 01 19:48:16.115685 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:16.115649 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6945cdf8f5-7czpg_3ec2a28f-ab7f-4b0b-9d75-e98068b66ed2/registry/0.log" Jul 01 19:48:16.201053 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:16.201017 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t2jkw_e48339a1-bd04-418d-97bf-ea2a62afa2f0/node-ca/0.log" Jul 01 19:48:17.049641 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:17.049608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d46b8597-b2hgl_0256c3cf-3b37-4daf-8bc0-2d56c2964def/router/0.log" Jul 01 19:48:17.485018 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:17.484993 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rk98g_30ca6c63-8e2e-4c35-a8b1-e1a67a42769a/serve-healthcheck-canary/0.log" Jul 01 19:48:18.154635 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:18.154604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-srhss_f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23/kube-rbac-proxy/0.log" Jul 01 19:48:18.180750 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:18.180721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-srhss_f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23/exporter/0.log" Jul 01 19:48:18.210716 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:18.210691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-srhss_f9b4e8f5-6ff0-4a18-9a0a-5b219e70ac23/extractor/0.log" Jul 01 19:48:20.499089 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:20.499060 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-sm9j2" Jul 01 19:48:25.392768 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:25.392735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-qtkrm_5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67/migrator/0.log" Jul 01 19:48:25.418589 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:25.418564 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-qtkrm_5cc66d9b-9c24-4ab8-a6aa-b8b9dd456a67/graceful-termination/0.log" Jul 01 19:48:26.791276 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:26.791243 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4q4wn_ebe0d367-517d-4389-b77a-1548a5db6f4f/kube-multus/0.log" Jul 01 19:48:27.009468 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.009441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/kube-multus-additional-cni-plugins/0.log" Jul 01 19:48:27.057147 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.057089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/egress-router-binary-copy/0.log" Jul 01 19:48:27.087838 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.087815 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/cni-plugins/0.log" Jul 01 19:48:27.118964 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.118937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/bond-cni-plugin/0.log" Jul 01 19:48:27.147971 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.147948 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/routeoverride-cni/0.log" Jul 01 19:48:27.174752 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.174731 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/whereabouts-cni-bincopy/0.log" Jul 01 19:48:27.197913 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.197887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrdbp_740bcff9-1be9-4693-bf44-b6cf23185fad/whereabouts-cni/0.log" Jul 01 19:48:27.563093 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.563065 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6djp_7a29044a-b5a6-4b29-8cd8-58fab4b0b59b/network-metrics-daemon/0.log" Jul 01 19:48:27.589498 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:27.589474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6djp_7a29044a-b5a6-4b29-8cd8-58fab4b0b59b/kube-rbac-proxy/0.log" Jul 01 19:48:28.371776 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.371746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-controller/0.log" Jul 01 19:48:28.398999 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.398973 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/0.log" Jul 01 19:48:28.399119 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.398975 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovn-acl-logging/1.log" Jul 01 19:48:28.421238 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.421201 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/kube-rbac-proxy-node/0.log" Jul 01 19:48:28.474960 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.474937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 19:48:28.529406 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.529376 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/northd/0.log" Jul 01 19:48:28.587285 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.587261 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/nbdb/0.log" Jul 01 19:48:28.628913 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.628832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/sbdb/0.log" Jul 01 19:48:28.673948 ip-10-0-133-159 kubenswrapper[2578]: I0701 19:48:28.673922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2krn_4bff37e6-e84e-448c-a8c2-94654087ea64/ovnkube-controller/0.log"