Jul 09 18:03:38.412358 ip-10-0-143-68 systemd[1]: Starting Kubernetes Kubelet... Jul 09 18:03:38.832365 ip-10-0-143-68 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:03:38.832365 ip-10-0-143-68 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 18:03:38.832365 ip-10-0-143-68 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:03:38.832365 ip-10-0-143-68 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 18:03:38.832365 ip-10-0-143-68 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:03:38.833191 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.833108 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 18:03:38.837385 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837369 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:03:38.837385 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837385 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837389 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837392 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837395 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837398 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837400 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837403 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837406 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837408 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837410 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837413 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837417 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837420 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837423 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837426 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837429 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837431 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837435 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837438 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837441 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:03:38.837448 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837443 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837446 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837448 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837450 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837453 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837456 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837459 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837461 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837464 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837466 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837469 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837471 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837474 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837476 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837479 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837481 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837484 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837486 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837489 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837491 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:03:38.838073 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837493 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837496 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837499 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837501 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837504 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837507 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837509 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837512 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837516 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837519 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837522 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837525 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837527 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837530 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837532 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837535 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837537 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837539 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837542 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:03:38.838861 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837544 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837546 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837549 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837551 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837553 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837556 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837561 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837563 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837567 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837569 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837572 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837574 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837577 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837580 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837582 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837586 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837590 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837595 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837598 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:03:38.839550 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837601 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837604 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837607 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837610 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837615 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837618 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837621 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837624 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837627 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837630 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837633 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837635 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837638 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837640 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837643 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837645 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837708 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837713 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.837716 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:03:38.840392 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840158 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840174 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840179 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840184 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840190 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840195 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840199 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840203 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840207 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840211 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840215 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840220 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840226 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840232 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840239 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840245 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840250 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840254 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840258 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:03:38.841181 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840262 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840266 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840270 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840274 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840278 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840283 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840287 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840292 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840296 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840301 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840305 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840317 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840323 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840327 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840331 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840335 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840340 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840344 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840348 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840352 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:03:38.842047 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840356 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840361 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840365 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840369 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840373 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840377 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840383 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840387 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840391 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840394 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840399 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840402 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840406 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840410 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840414 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840418 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840423 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840428 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840432 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:03:38.842921 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840440 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840447 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840452 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840457 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840463 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840467 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840471 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840476 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840480 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840483 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840488 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840492 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840496 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840500 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840504 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840509 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840513 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840517 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840521 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840525 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:03:38.843637 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840529 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840533 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840537 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840541 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840545 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840550 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840554 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840558 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840562 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840566 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840570 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840574 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840579 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840583 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840596 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840600 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840605 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840609 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840613 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840617 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:03:38.844148 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.840622 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841315 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841326 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841332 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841338 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841342 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841346 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841351 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841355 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841360 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841364 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841368 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841373 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841377 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841382 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841386 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841391 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841395 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841399 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841404 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:03:38.844630 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841408 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841412 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841417 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841421 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841426 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841430 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841435 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841439 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841443 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841447 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841451 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841455 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841459 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841466 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841472 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841477 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841483 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841488 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841493 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:03:38.845140 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841498 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841502 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841506 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841511 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841515 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841519 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841523 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841527 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841532 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841538 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841542 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841546 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841550 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841554 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841558 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841562 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841566 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841571 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841576 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841581 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:03:38.845601 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841586 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841590 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841594 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841598 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841602 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841606 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841610 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841615 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841620 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841624 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841629 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841634 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841638 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841642 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841646 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841650 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841654 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841658 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841662 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841666 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:03:38.846194 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841670 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841676 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841681 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841685 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841689 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841694 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841698 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841702 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841706 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841711 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841717 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841723 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841728 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841732 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841738 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841744 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841749 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841754 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841759 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:03:38.846850 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841763 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.841767 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841897 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841914 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841925 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841931 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841938 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841943 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841950 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841957 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841963 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841968 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841973 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841978 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841983 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841989 2564 flags.go:64] FLAG: --cgroup-root="" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841993 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.841999 2564 flags.go:64] FLAG: --client-ca-file="" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842003 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842008 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842015 2564 flags.go:64] FLAG: --cluster-domain="" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842019 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842042 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842048 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 18:03:38.847415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842054 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842059 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842064 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842069 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842074 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842078 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842083 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842087 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842092 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842096 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842103 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842109 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842113 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842118 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842122 2564 flags.go:64] FLAG: --enable-server="true" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842127 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842135 2564 flags.go:64] FLAG: --event-burst="100" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842139 2564 flags.go:64] FLAG: --event-qps="50" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842144 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842149 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842154 2564 flags.go:64] FLAG: --eviction-hard="" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842160 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842165 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842170 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842175 2564 flags.go:64] FLAG: --eviction-soft="" Jul 09 18:03:38.848088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842181 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842185 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842190 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842198 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842203 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842208 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842212 2564 flags.go:64] FLAG: --feature-gates="" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842218 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842223 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842228 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842233 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842238 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842243 2564 flags.go:64] FLAG: --help="false" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842248 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-68.ec2.internal" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842253 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842257 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842262 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842268 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842274 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842278 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842283 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842287 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842292 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 18:03:38.848734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842296 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842301 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842306 2564 flags.go:64] FLAG: --kube-reserved="" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842311 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842315 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842322 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842327 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842331 2564 flags.go:64] FLAG: --lock-file="" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842336 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842341 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842346 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842355 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842361 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842366 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842371 2564 flags.go:64] FLAG: --logging-format="text" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842376 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842381 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842386 2564 flags.go:64] FLAG: --manifest-url="" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842391 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842397 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842402 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842408 2564 flags.go:64] FLAG: --max-pods="110" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842413 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842419 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842423 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 18:03:38.849419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842428 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842433 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842438 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842442 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842455 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842459 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842465 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842469 2564 flags.go:64] FLAG: --pod-cidr="" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842474 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842483 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842487 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842492 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842498 2564 flags.go:64] FLAG: --port="10250" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842503 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842508 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0529e5f0ea44c42b9" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842513 2564 flags.go:64] FLAG: --qos-reserved="" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842518 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842523 2564 flags.go:64] FLAG: --register-node="true" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842528 2564 flags.go:64] FLAG: --register-with-taints="" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842543 2564 flags.go:64] FLAG: --registry-burst="10" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842549 2564 flags.go:64] FLAG: --registry-qps="5" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842554 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842559 2564 flags.go:64] FLAG: --reserved-memory="" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842565 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842570 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 18:03:38.850019 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842576 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842580 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842585 2564 flags.go:64] FLAG: --runonce="false" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842589 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842594 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842599 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842603 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842608 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842613 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842618 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842623 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842627 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842632 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842636 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842640 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842645 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842650 2564 flags.go:64] FLAG: --system-cgroups="" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842655 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842663 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842669 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842674 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842680 2564 flags.go:64] FLAG: --tls-min-version="" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842685 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842689 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842694 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 18:03:38.850651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842700 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842705 2564 flags.go:64] FLAG: --v="2" Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842714 2564 flags.go:64] FLAG: --version="false" Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842720 2564 flags.go:64] FLAG: --vmodule="" Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842725 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.842731 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842927 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842934 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842939 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842944 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842949 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842954 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842958 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842962 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842966 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842971 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842975 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842980 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842984 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842988 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842992 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:03:38.851308 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.842996 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843000 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843005 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843009 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843014 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843019 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843024 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843051 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843055 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843059 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843063 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843068 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843073 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843080 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843084 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843088 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843093 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843097 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843104 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843111 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:03:38.851884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843115 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843120 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843124 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843128 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843132 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843136 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843140 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843145 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843149 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843154 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843158 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843163 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843167 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843171 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843175 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843179 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843183 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843189 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843193 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843197 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:03:38.852475 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843201 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843206 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843210 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843214 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843219 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843235 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843240 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843245 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843249 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843254 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843258 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843262 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843266 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843271 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843275 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843279 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843283 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843287 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843291 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843295 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:03:38.852966 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843299 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843303 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843307 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843314 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843319 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843324 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843329 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843333 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843337 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843343 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843347 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843351 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843356 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843360 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843366 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843372 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843377 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843383 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843389 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:03:38.853476 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843394 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843398 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843403 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843407 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.843412 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.845807 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.853143 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.853161 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.853180 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.853186 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853242 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853248 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853252 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853256 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853259 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:03:38.853926 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853262 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853265 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853269 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853273 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853276 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853279 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853282 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853285 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853289 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853293 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853296 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853299 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853302 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853304 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853307 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853309 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853313 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853316 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853319 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:03:38.854322 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853321 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853324 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853326 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853329 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853331 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853334 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853337 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853339 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853342 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853344 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853347 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853349 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853352 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853354 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853357 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853359 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853362 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853365 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853367 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853370 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:03:38.854795 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853372 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853375 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853377 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853380 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853382 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853384 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853387 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853390 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853392 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853395 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853398 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853401 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853403 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853406 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853408 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853410 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853413 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853416 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853418 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:03:38.855296 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853421 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853424 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853426 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853429 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853431 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853434 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853436 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853438 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853441 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853443 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853446 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853448 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853451 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853453 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853456 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853458 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853461 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853463 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853466 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853468 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:03:38.855751 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853471 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853474 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853476 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853479 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853482 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853485 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853487 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853490 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853492 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853495 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853499 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853503 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853506 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853508 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853511 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:03:38.856241 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853514 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.853519 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853636 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853640 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853643 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853646 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853649 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853652 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853658 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853661 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853663 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853667 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853671 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:03:38.856600 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853673 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853676 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853680 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853683 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853686 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853689 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853692 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853695 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853698 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853702 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853704 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853706 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853709 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853711 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853714 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853716 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853719 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853721 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853724 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:03:38.856933 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853726 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853729 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853731 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853733 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853736 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853738 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853740 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853743 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853745 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853748 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853750 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853753 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853755 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853757 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853760 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853762 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853765 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853767 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853770 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853772 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:03:38.857418 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853775 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853778 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853781 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853783 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853786 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853788 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853791 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853793 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853795 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853798 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853800 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853803 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853805 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853807 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853810 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853812 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853814 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853817 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853819 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853822 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:03:38.857898 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853824 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853826 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853829 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853831 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853833 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853836 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853839 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853841 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853843 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853846 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853848 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853851 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853853 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853856 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853858 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853862 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853864 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853867 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853869 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853872 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:03:38.858395 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853874 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853877 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853879 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853882 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853885 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853887 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853890 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:38.853892 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.853897 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.854010 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.856204 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.857538 2564 server.go:1019] "Starting client certificate rotation" Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.857633 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 18:03:38.858884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.857669 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 18:03:38.859865 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.859851 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 18:03:38.863863 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.863847 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 18:03:38.876807 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.876785 2564 log.go:25] "Validated CRI v1 runtime API" Jul 09 18:03:38.879430 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.879411 2564 log.go:25] "Validated CRI v1 image API" Jul 09 18:03:38.880962 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.880942 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 18:03:38.884580 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.884545 2564 fs.go:135] Filesystem UUIDs: map[1c0e75ed-0aa5-404f-b2df-43d2decac6ae:/dev/nvme0n1p3 63b34a42-001c-421e-b5f7-a0841adb2479:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 18:03:38.884688 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.884577 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 18:03:38.890698 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.890580 2564 manager.go:216] Machine: {Timestamp:2026-07-09 18:03:38.889487121 +0000 UTC m=+0.347303645 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3192920 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad5d571b6e53e0d5909e6966538b6 SystemUUID:ec2ad5d5-71b6-e53e-0d59-09e6966538b6 BootID:a77ad872-a37c-49d0-be9f-56ddca05a3ce Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:64:65:22:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:64:65:22:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:88:b6:7c:23:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 18:03:38.890698 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.890685 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 18:03:38.890882 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.890802 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 18:03:38.891102 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.891081 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 18:03:38.893768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.893737 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 18:03:38.893910 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.893771 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 18:03:38.894495 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.894485 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 18:03:38.894541 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.894497 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 18:03:38.894541 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.894506 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 18:03:38.895140 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.895129 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 18:03:38.896256 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.896247 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 18:03:38.898787 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898776 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 18:03:38.898909 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898899 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 18:03:38.898947 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898929 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 09 18:03:38.898947 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898939 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 18:03:38.899008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898949 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 18:03:38.899008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898959 2564 kubelet.go:398] "Adding apiserver pod source" Jul 09 18:03:38.899008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.898969 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 18:03:38.899340 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.899329 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 18:03:38.899383 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.899362 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 18:03:38.901394 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.901377 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 18:03:38.903496 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903481 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 18:03:38.903564 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903511 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 18:03:38.903721 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903708 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 18:03:38.903775 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903727 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 18:03:38.903775 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903735 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 18:03:38.903775 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903740 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 18:03:38.903917 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903779 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 18:03:38.903917 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.903790 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 18:03:38.904340 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904330 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 18:03:38.904340 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904341 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 18:03:38.904404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904348 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 18:03:38.904404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904353 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 18:03:38.904404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904366 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 18:03:38.904404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904373 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 18:03:38.904959 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904951 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 18:03:38.904994 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.904960 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 18:03:38.908523 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.908501 2564 server.go:1268] "Started kubelet" Jul 09 18:03:38.908619 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.908538 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 18:03:38.908844 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.908672 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 18:03:38.908999 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.908980 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 18:03:38.909470 ip-10-0-143-68 systemd[1]: Started Kubernetes Kubelet. Jul 09 18:03:38.912978 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.912935 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 18:03:38.913113 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.913062 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 18:03:38.913272 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.913132 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 18:03:38.913345 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.913324 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 18:03:38.915282 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.915258 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 18:03:38.916354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.916340 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 09 18:03:38.921389 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.920611 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-68.ec2.internal.18c0b1239a3e1fff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-68.ec2.internal,UID:ip-10-0-143-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-68.ec2.internal,},FirstTimestamp:2026-07-09 18:03:38.908450815 +0000 UTC m=+0.366267337,LastTimestamp:2026-07-09 18:03:38.908450815 +0000 UTC m=+0.366267337,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-68.ec2.internal,}" Jul 09 18:03:38.924671 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.924650 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 18:03:38.924759 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.924672 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 18:03:38.924812 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.924781 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:38.925566 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925436 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 18:03:38.925566 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925481 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 18:03:38.925566 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925543 2564 factory.go:55] Registering systemd factory Jul 09 18:03:38.925727 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925578 2564 factory.go:223] Registration of the systemd container factory successfully Jul 09 18:03:38.925727 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925599 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 09 18:03:38.925727 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925605 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 09 18:03:38.925727 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925604 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 18:03:38.925913 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925849 2564 factory.go:153] Registering CRI-O factory Jul 09 18:03:38.925913 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925862 2564 factory.go:223] Registration of the crio container factory successfully Jul 09 18:03:38.926009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925925 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 18:03:38.926009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925944 2564 factory.go:103] Registering Raw factory Jul 09 18:03:38.926009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.925956 2564 manager.go:1196] Started watching for new ooms in manager Jul 09 18:03:38.926565 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.926550 2564 manager.go:349] Starting recovery of all containers Jul 09 18:03:38.935131 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.934949 2564 manager.go:354] Recovery completed Jul 09 18:03:38.935131 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.935110 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 18:03:38.935305 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.935219 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 18:03:38.939616 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.939600 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:38.941023 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.941006 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4t7nq" Jul 09 18:03:38.941467 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.941446 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:38.941508 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.941475 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:38.941508 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.941486 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:38.941997 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.941985 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 18:03:38.941997 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.941995 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 18:03:38.942124 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.942011 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 18:03:38.942124 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.942063 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:38.942785 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.942771 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:38.942836 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.942797 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:38.942836 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.942807 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:38.943277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.943265 2564 policy_none.go:49] "None policy: Start" Jul 09 18:03:38.943322 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.943282 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 18:03:38.943322 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.943293 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 18:03:38.944161 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.944144 2564 policy_none.go:47] "Start" Jul 09 18:03:38.949486 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.949381 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-68.ec2.internal.18c0b1239c35d279 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-68.ec2.internal,UID:ip-10-0-143-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-68.ec2.internal,},FirstTimestamp:2026-07-09 18:03:38.941461113 +0000 UTC m=+0.399277638,LastTimestamp:2026-07-09 18:03:38.941461113 +0000 UTC m=+0.399277638,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-68.ec2.internal,}" Jul 09 18:03:38.949760 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.949743 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4t7nq" Jul 09 18:03:38.956343 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.956279 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-68.ec2.internal.18c0b1239c361be1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-68.ec2.internal,UID:ip-10-0-143-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-68.ec2.internal,},FirstTimestamp:2026-07-09 18:03:38.941479905 +0000 UTC m=+0.399296431,LastTimestamp:2026-07-09 18:03:38.941479905 +0000 UTC m=+0.399296431,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-68.ec2.internal,}" Jul 09 18:03:38.978702 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.978683 2564 manager.go:337] "Starting Device Plugin manager" Jul 09 18:03:38.978800 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.978720 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 18:03:38.978800 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.978732 2564 server.go:87] "Starting device plugin registration server" Jul 09 18:03:38.979084 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.979070 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 18:03:38.979121 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.979086 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 18:03:38.979453 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.979438 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 18:03:38.979527 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.979517 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 18:03:38.979556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:38.979529 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 18:03:38.980890 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.980853 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 18:03:38.980981 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:38.980901 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.054519 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.054477 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 18:03:39.055914 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.055887 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 18:03:39.056051 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.055938 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 18:03:39.056051 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.055967 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 18:03:39.056051 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.056010 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 18:03:39.058661 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.058639 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:03:39.079700 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.079671 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:39.080844 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.080823 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:39.080918 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.080863 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:39.080918 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.080875 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:39.080918 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.080905 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.092144 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.092093 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.092144 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.092119 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-68.ec2.internal\": node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.122778 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.122752 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.156369 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.156340 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal"] Jul 09 18:03:39.156497 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.156411 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:39.158347 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.158330 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:39.158427 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.158360 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:39.158427 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.158373 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:39.159528 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.159515 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:39.159642 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.159627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.159675 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.159659 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:39.160304 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.160290 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:39.160368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.160302 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:39.160368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.160313 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:39.160368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.160324 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:39.160368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.160327 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:39.160368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.160335 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:39.161535 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.161514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.161535 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.161539 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:39.162543 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.162516 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:39.162643 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.162557 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:39.162643 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.162570 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:39.189840 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.189806 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-68.ec2.internal\" not found" node="ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.194189 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.194170 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-68.ec2.internal\" not found" node="ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.223092 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.223066 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.227149 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.227129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f507c596cc52138e28220f2146c8bfd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"f507c596cc52138e28220f2146c8bfd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.227210 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.227158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f507c596cc52138e28220f2146c8bfd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"f507c596cc52138e28220f2146c8bfd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.227210 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.227185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/461a8c1189d3fa14a8ddfb5e1ff91d87-config\") pod \"kube-apiserver-proxy-ip-10-0-143-68.ec2.internal\" (UID: \"461a8c1189d3fa14a8ddfb5e1ff91d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.323433 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.323393 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.327777 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.327757 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f507c596cc52138e28220f2146c8bfd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"f507c596cc52138e28220f2146c8bfd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.327833 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.327799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f507c596cc52138e28220f2146c8bfd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"f507c596cc52138e28220f2146c8bfd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.327833 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.327826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/461a8c1189d3fa14a8ddfb5e1ff91d87-config\") pod \"kube-apiserver-proxy-ip-10-0-143-68.ec2.internal\" (UID: \"461a8c1189d3fa14a8ddfb5e1ff91d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.327894 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.327865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f507c596cc52138e28220f2146c8bfd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"f507c596cc52138e28220f2146c8bfd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.327894 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.327876 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/461a8c1189d3fa14a8ddfb5e1ff91d87-config\") pod \"kube-apiserver-proxy-ip-10-0-143-68.ec2.internal\" (UID: \"461a8c1189d3fa14a8ddfb5e1ff91d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.327894 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.327874 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f507c596cc52138e28220f2146c8bfd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"f507c596cc52138e28220f2146c8bfd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.424319 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.424241 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.492748 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.492720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.497777 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.497753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Jul 09 18:03:39.525379 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.525343 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.625838 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.625786 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.726385 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.726291 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.826749 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.826717 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.857090 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.857058 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 18:03:39.857708 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.857218 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 18:03:39.927158 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:39.927124 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:39.953008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.952952 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:58:39 +0000 UTC" deadline="2028-02-06 00:09:11.642848635 +0000 UTC" Jul 09 18:03:39.953008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:39.953006 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13830h5m31.68984702s" Jul 09 18:03:40.027520 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.027442 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:40.067641 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:40.067610 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461a8c1189d3fa14a8ddfb5e1ff91d87.slice/crio-0e5bfdbce0dcddf1c7d65145b322a4b5b5c034bfdf263202abef6c02c47b6406 WatchSource:0}: Error finding container 0e5bfdbce0dcddf1c7d65145b322a4b5b5c034bfdf263202abef6c02c47b6406: Status 404 returned error can't find the container with id 0e5bfdbce0dcddf1c7d65145b322a4b5b5c034bfdf263202abef6c02c47b6406 Jul 09 18:03:40.068107 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:40.068082 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf507c596cc52138e28220f2146c8bfd0.slice/crio-301a80ce0ac22bb8b3c40d675e930534cf8b80edd2967041ae180f0a06f400c4 WatchSource:0}: Error finding container 301a80ce0ac22bb8b3c40d675e930534cf8b80edd2967041ae180f0a06f400c4: Status 404 returned error can't find the container with id 301a80ce0ac22bb8b3c40d675e930534cf8b80edd2967041ae180f0a06f400c4 Jul 09 18:03:40.073687 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.073671 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 18:03:40.088572 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.088551 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:03:40.103560 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.103535 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:03:40.104827 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.104811 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:03:40.104896 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.104841 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:03:40.104896 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.104850 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:03:40.108806 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.108792 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:03:40.127771 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.127749 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:40.228316 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.228288 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:40.328603 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.328569 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:40.429687 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.429654 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Jul 09 18:03:40.458339 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.458311 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:03:40.525741 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.525704 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Jul 09 18:03:40.542063 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.542020 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 18:03:40.543399 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.543368 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Jul 09 18:03:40.552015 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.551705 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 18:03:40.899955 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.899926 2564 apiserver.go:52] "Watching apiserver" Jul 09 18:03:40.901543 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.901494 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:03:40.908826 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.908793 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 18:03:40.909369 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.909339 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal","openshift-multus/multus-additional-cni-plugins-pvjtn","openshift-multus/multus-spsr7","openshift-network-diagnostics/network-check-target-kjwj7","openshift-ovn-kubernetes/ovnkube-node-cqvlv","kube-system/global-pull-secret-syncer-cg4q9","kube-system/konnectivity-agent-b2qzt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt","openshift-cluster-node-tuning-operator/tuned-jmqx8","openshift-dns/node-resolver-dmbxn","openshift-image-registry/node-ca-kmw2x","openshift-multus/network-metrics-daemon-vgxd7","openshift-network-operator/iptables-alerter-b29jj","kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal"] Jul 09 18:03:40.911082 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.911028 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:40.911201 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.911144 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:40.913013 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.912444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.913648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.913629 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:40.915377 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.915109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.916792 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.916620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.917708 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.917682 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 18:03:40.918155 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.918133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.918358 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.918342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:40.918434 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.918408 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:40.918695 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.918673 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.918973 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.918954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 18:03:40.919834 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.919728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2s8ql\"" Jul 09 18:03:40.919834 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.919788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.920143 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.920116 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 18:03:40.920360 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.920342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sjrm8\"" Jul 09 18:03:40.920556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.920531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.920677 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.920657 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.921012 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.920994 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 18:03:40.921311 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.921291 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 18:03:40.921421 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.921402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvh4t\"" Jul 09 18:03:40.921483 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.921298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 18:03:40.921618 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.921600 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 18:03:40.921688 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.921651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.922680 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.922480 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:40.923070 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.923049 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.923218 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.923174 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 18:03:40.923419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.923402 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 18:03:40.923521 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.923503 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-swqr2\"" Jul 09 18:03:40.924522 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.924339 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 18:03:40.924780 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.924721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:40.924910 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.924886 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 18:03:40.925355 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.925336 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 18:03:40.926128 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.926109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:40.926219 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:40.926182 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:40.929051 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.927290 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:40.929051 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.928160 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.929051 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.928183 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.929270 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.929078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-shccz\"" Jul 09 18:03:40.929485 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.929465 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.930208 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.930188 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mptt9\"" Jul 09 18:03:40.932709 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.930540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.932709 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.932090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.932709 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.932192 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l9h99\"" Jul 09 18:03:40.933082 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.932931 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.933082 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.932943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.933082 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.932960 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 18:03:40.934459 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.933363 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 18:03:40.934459 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.933531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 18:03:40.934459 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.933894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 18:03:40.934654 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.934547 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hklls\"" Jul 09 18:03:40.934914 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.934848 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fm585\"" Jul 09 18:03:40.936876 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6-agent-certs\") pod \"konnectivity-agent-b2qzt\" (UID: \"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6\") " pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:40.936988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysctl-d\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.936988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-log-socket\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.936988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-cni-netd\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.936988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.936988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-tmp\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.936993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjvvt\" (UniqueName: \"kubernetes.io/projected/bb30feae-bed2-4d73-9ae1-da99c55e18d6-kube-api-access-zjvvt\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-var-lib-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-kubernetes\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-run\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14256da0-5916-43c0-ad56-8ce687a9191d-host\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k86kj\" (UniqueName: \"kubernetes.io/projected/14256da0-5916-43c0-ad56-8ce687a9191d-kube-api-access-k86kj\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:40.937277 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-etc-kubernetes\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-sys\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bckz\" (UniqueName: \"kubernetes.io/projected/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-kube-api-access-4bckz\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-socket-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-cni-multus\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-dbus\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b765dd66-7175-4c20-a287-85756a566cad-iptables-alerter-script\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-k8s-cni-cncf-io\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-node-log\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9v27\" (UniqueName: \"kubernetes.io/projected/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-kube-api-access-g9v27\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-cni-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljvp\" (UniqueName: \"kubernetes.io/projected/0fe86208-9ae2-477c-b7f4-7d75baff8104-kube-api-access-nljvp\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.937725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xsq\" (UniqueName: \"kubernetes.io/projected/a7935b3f-a980-4103-bd54-e85a0510cd7f-kube-api-access-z2xsq\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-systemd-units\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-os-release\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-tmp-dir\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/14256da0-5916-43c0-ad56-8ce687a9191d-serviceca\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7htpb\" (UniqueName: \"kubernetes.io/projected/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-kube-api-access-7htpb\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-kubelet\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.937967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-conf-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-ovn\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b765dd66-7175-4c20-a287-85756a566cad-host-slash\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-cnibin\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysctl-conf\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-device-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-daemon-config\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.938556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-slash\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/932dba37-1789-4a2c-9a3b-91cdf3156045-ovn-node-metrics-cert\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-lib-modules\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-registration-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-cni-bin\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-etc-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-kubelet-config\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6-konnectivity-ca\") pod \"konnectivity-agent-b2qzt\" (UID: \"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6\") " pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-modprobe-d\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-host\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-env-overrides\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-tuned\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-hosts-file\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-os-release\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.939400 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-ovnkube-script-lib\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9tf\" (UniqueName: \"kubernetes.io/projected/b765dd66-7175-4c20-a287-85756a566cad-kube-api-access-wq9tf\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-system-cni-dir\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysconfig\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-systemd\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-socket-dir-parent\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-netns\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.938983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-kubelet\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-systemd\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-ovnkube-config\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-var-lib-kubelet\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-cnibin\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-sys-fs\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-system-cni-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-hostroot\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-run-netns\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.940253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-cni-bin\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.941139 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fc7b\" (UniqueName: \"kubernetes.io/projected/932dba37-1789-4a2c-9a3b-91cdf3156045-kube-api-access-6fc7b\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:40.941139 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fe86208-9ae2-477c-b7f4-7d75baff8104-cni-binary-copy\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.941139 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.939285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-multus-certs\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:40.955581 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.955552 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 18:03:40.992005 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:40.991967 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-znp8m" Jul 09 18:03:41.001963 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.001932 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-znp8m" Jul 09 18:03:41.026561 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.026529 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 18:03:41.039684 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-os-release\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.039824 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-ovnkube-script-lib\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.039824 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9tf\" (UniqueName: \"kubernetes.io/projected/b765dd66-7175-4c20-a287-85756a566cad-kube-api-access-wq9tf\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.039824 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-system-cni-dir\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.039824 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysconfig\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.039824 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-systemd\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.039824 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-socket-dir-parent\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-netns\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-kubelet\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-systemd\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-ovnkube-config\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-var-lib-kubelet\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-cnibin\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.039984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-sys-fs\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-system-cni-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-hostroot\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-run-netns\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-cni-bin\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fc7b\" (UniqueName: \"kubernetes.io/projected/932dba37-1789-4a2c-9a3b-91cdf3156045-kube-api-access-6fc7b\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040229 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-os-release\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fe86208-9ae2-477c-b7f4-7d75baff8104-cni-binary-copy\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-cnibin\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040404 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-socket-dir-parent\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040410 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-system-cni-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysconfig\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-systemd\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-hostroot\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-sys-fs\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-multus-certs\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-netns\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040274 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-system-cni-dir\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-multus-certs\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6-agent-certs\") pod \"konnectivity-agent-b2qzt\" (UID: \"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6\") " pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040607 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-systemd\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040615 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-cni-bin\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.040763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysctl-d\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-kubelet\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-log-socket\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-cni-netd\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040914 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.040985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-tmp\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjvvt\" (UniqueName: \"kubernetes.io/projected/bb30feae-bed2-4d73-9ae1-da99c55e18d6-kube-api-access-zjvvt\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041272 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-ovnkube-config\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-cni-netd\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-var-lib-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-kubernetes\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-var-lib-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-var-lib-kubelet\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-run\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041402 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-ovnkube-script-lib\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysctl-d\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-run-netns\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.041636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-run\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-log-socket\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041597 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-kubernetes\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.041668 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fe86208-9ae2-477c-b7f4-7d75baff8104-cni-binary-copy\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14256da0-5916-43c0-ad56-8ce687a9191d-host\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.041771 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:41.541749299 +0000 UTC m=+2.999565831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-etc-selinux\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041774 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k86kj\" (UniqueName: \"kubernetes.io/projected/14256da0-5916-43c0-ad56-8ce687a9191d-kube-api-access-k86kj\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-etc-kubernetes\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14256da0-5916-43c0-ad56-8ce687a9191d-host\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-sys\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bckz\" (UniqueName: \"kubernetes.io/projected/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-kube-api-access-4bckz\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.042624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041961 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-etc-kubernetes\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.041928 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-sys\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-socket-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-cni-multus\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042099 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-dbus\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-cni-multus\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042162 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-socket-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b765dd66-7175-4c20-a287-85756a566cad-iptables-alerter-script\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-k8s-cni-cncf-io\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-node-log\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042292 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-run-k8s-cni-cncf-io\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042342 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-node-log\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9v27\" (UniqueName: \"kubernetes.io/projected/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-kube-api-access-g9v27\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.043515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-dbus\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-cni-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljvp\" (UniqueName: \"kubernetes.io/projected/0fe86208-9ae2-477c-b7f4-7d75baff8104-kube-api-access-nljvp\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-cni-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xsq\" (UniqueName: \"kubernetes.io/projected/a7935b3f-a980-4103-bd54-e85a0510cd7f-kube-api-access-z2xsq\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-systemd-units\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-os-release\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-tmp-dir\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/14256da0-5916-43c0-ad56-8ce687a9191d-serviceca\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7htpb\" (UniqueName: \"kubernetes.io/projected/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-kube-api-access-7htpb\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-os-release\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042789 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b765dd66-7175-4c20-a287-85756a566cad-iptables-alerter-script\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042823 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-systemd-units\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-kubelet\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.044354 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-conf-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042878 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-kubelet\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042893 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-ovn\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042898 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b765dd66-7175-4c20-a287-85756a566cad-host-slash\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042936 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-ovn\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-cnibin\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042992 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7935b3f-a980-4103-bd54-e85a0510cd7f-cnibin\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043058 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b765dd66-7175-4c20-a287-85756a566cad-host-slash\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysctl-conf\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-device-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-conf-dir\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-daemon-config\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-slash\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043243 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-tmp-dir\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/932dba37-1789-4a2c-9a3b-91cdf3156045-ovn-node-metrics-cert\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.042866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-run-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.045222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-lib-modules\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-registration-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-cni-bin\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043430 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-sysctl-conf\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043467 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7935b3f-a980-4103-bd54-e85a0510cd7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043473 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-host-slash\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-etc-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-lib-modules\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-kubelet-config\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-kubelet-config\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043582 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fe86208-9ae2-477c-b7f4-7d75baff8104-host-var-lib-cni-bin\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-device-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932dba37-1789-4a2c-9a3b-91cdf3156045-etc-openvswitch\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.043509 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:41.046352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/14256da0-5916-43c0-ad56-8ce687a9191d-serviceca\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb30feae-bed2-4d73-9ae1-da99c55e18d6-registration-dir\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.043715 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:03:41.543696513 +0000 UTC m=+3.001513040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6-konnectivity-ca\") pod \"konnectivity-agent-b2qzt\" (UID: \"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6\") " pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-modprobe-d\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-host\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fe86208-9ae2-477c-b7f4-7d75baff8104-multus-daemon-config\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-env-overrides\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-tuned\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-host\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-hosts-file\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043868 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-modprobe-d\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.043986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-hosts-file\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.044266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/932dba37-1789-4a2c-9a3b-91cdf3156045-env-overrides\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.044481 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6-konnectivity-ca\") pod \"konnectivity-agent-b2qzt\" (UID: \"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6\") " pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.045488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-tmp\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.047298 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.046737 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/932dba37-1789-4a2c-9a3b-91cdf3156045-ovn-node-metrics-cert\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.047945 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.047610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-etc-tuned\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.049711 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.049687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9tf\" (UniqueName: \"kubernetes.io/projected/b765dd66-7175-4c20-a287-85756a566cad-kube-api-access-wq9tf\") pod \"iptables-alerter-b29jj\" (UID: \"b765dd66-7175-4c20-a287-85756a566cad\") " pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.050217 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.050197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6-agent-certs\") pod \"konnectivity-agent-b2qzt\" (UID: \"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6\") " pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:41.050359 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.050321 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fc7b\" (UniqueName: \"kubernetes.io/projected/932dba37-1789-4a2c-9a3b-91cdf3156045-kube-api-access-6fc7b\") pod \"ovnkube-node-cqvlv\" (UID: \"932dba37-1789-4a2c-9a3b-91cdf3156045\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.055541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k86kj\" (UniqueName: \"kubernetes.io/projected/14256da0-5916-43c0-ad56-8ce687a9191d-kube-api-access-k86kj\") pod \"node-ca-kmw2x\" (UID: \"14256da0-5916-43c0-ad56-8ce687a9191d\") " pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.055934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljvp\" (UniqueName: \"kubernetes.io/projected/0fe86208-9ae2-477c-b7f4-7d75baff8104-kube-api-access-nljvp\") pod \"multus-spsr7\" (UID: \"0fe86208-9ae2-477c-b7f4-7d75baff8104\") " pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.056783 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.056810 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.056829 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.056904 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:41.556879339 +0000 UTC m=+3.014695871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.057722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjvvt\" (UniqueName: \"kubernetes.io/projected/bb30feae-bed2-4d73-9ae1-da99c55e18d6-kube-api-access-zjvvt\") pod \"aws-ebs-csi-driver-node-wv5tt\" (UID: \"bb30feae-bed2-4d73-9ae1-da99c55e18d6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.059221 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.058645 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9v27\" (UniqueName: \"kubernetes.io/projected/3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9-kube-api-access-g9v27\") pod \"tuned-jmqx8\" (UID: \"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9\") " pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.059907 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.059812 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bckz\" (UniqueName: \"kubernetes.io/projected/745e7b74-43a1-48c1-bb51-2cfce52bbfb5-kube-api-access-4bckz\") pod \"node-resolver-dmbxn\" (UID: \"745e7b74-43a1-48c1-bb51-2cfce52bbfb5\") " pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.062152 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.062123 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7htpb\" (UniqueName: \"kubernetes.io/projected/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-kube-api-access-7htpb\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:41.062252 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.062168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" event={"ID":"461a8c1189d3fa14a8ddfb5e1ff91d87","Type":"ContainerStarted","Data":"0e5bfdbce0dcddf1c7d65145b322a4b5b5c034bfdf263202abef6c02c47b6406"} Jul 09 18:03:41.062340 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.062316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xsq\" (UniqueName: \"kubernetes.io/projected/a7935b3f-a980-4103-bd54-e85a0510cd7f-kube-api-access-z2xsq\") pod \"multus-additional-cni-plugins-pvjtn\" (UID: \"a7935b3f-a980-4103-bd54-e85a0510cd7f\") " pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.064440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.064406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" event={"ID":"f507c596cc52138e28220f2146c8bfd0","Type":"ContainerStarted","Data":"301a80ce0ac22bb8b3c40d675e930534cf8b80edd2967041ae180f0a06f400c4"} Jul 09 18:03:41.236356 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.236265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" Jul 09 18:03:41.247000 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.246972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:03:41.258085 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.258052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-spsr7" Jul 09 18:03:41.263483 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.263452 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:03:41.271378 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.271351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" Jul 09 18:03:41.279321 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.279289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" Jul 09 18:03:41.292388 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.292357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmbxn" Jul 09 18:03:41.300415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.300387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmw2x" Jul 09 18:03:41.308297 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.308268 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b29jj" Jul 09 18:03:41.547622 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.547512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:41.547808 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.547622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:41.547808 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.547688 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:41.547808 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.547736 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:41.547808 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.547806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:42.547787473 +0000 UTC m=+4.005603987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:41.548040 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.547826 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:03:42.547817022 +0000 UTC m=+4.005633535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:41.648371 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:41.648330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:41.648539 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.648491 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:03:41.648539 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.648510 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:03:41.648539 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.648523 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:41.648693 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:41.648581 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:42.648568854 +0000 UTC m=+4.106385366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:42.005157 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.005107 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:58:41 +0000 UTC" deadline="2027-12-19 17:43:55.445739474 +0000 UTC" Jul 09 18:03:42.005157 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.005145 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12671h40m13.440597612s" Jul 09 18:03:42.056622 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.056579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:42.056622 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.056606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:42.056798 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.056606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:42.056798 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.056731 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:42.056878 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.056851 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:42.056946 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.056932 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:42.062870 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:42.062789 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14256da0_5916_43c0_ad56_8ce687a9191d.slice/crio-93f8698d79143b871e08fbf49e79f2e4a6119853d9b94c5492c09203456626a9 WatchSource:0}: Error finding container 93f8698d79143b871e08fbf49e79f2e4a6119853d9b94c5492c09203456626a9: Status 404 returned error can't find the container with id 93f8698d79143b871e08fbf49e79f2e4a6119853d9b94c5492c09203456626a9 Jul 09 18:03:42.071402 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:42.071373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7935b3f_a980_4103_bd54_e85a0510cd7f.slice/crio-55d6609df9553a867573b736d5566acc1bbad7495b2577cc1eb32cb09d6534cb WatchSource:0}: Error finding container 55d6609df9553a867573b736d5566acc1bbad7495b2577cc1eb32cb09d6534cb: Status 404 returned error can't find the container with id 55d6609df9553a867573b736d5566acc1bbad7495b2577cc1eb32cb09d6534cb Jul 09 18:03:42.072344 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.072299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmw2x" event={"ID":"14256da0-5916-43c0-ad56-8ce687a9191d","Type":"ContainerStarted","Data":"93f8698d79143b871e08fbf49e79f2e4a6119853d9b94c5492c09203456626a9"} Jul 09 18:03:42.077266 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:42.077234 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc78bd7_1012_4fe6_b458_1a85a7ca5ec6.slice/crio-a879e93d1ac7017c3f15deb5894670c7d883b477b59bc408767692544c206367 WatchSource:0}: Error finding container a879e93d1ac7017c3f15deb5894670c7d883b477b59bc408767692544c206367: Status 404 returned error can't find the container with id a879e93d1ac7017c3f15deb5894670c7d883b477b59bc408767692544c206367 Jul 09 18:03:42.077853 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:42.077831 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745e7b74_43a1_48c1_bb51_2cfce52bbfb5.slice/crio-1f184c5c2a51939c6b93397109be430e05cb3aef03a4c7ef936ed78302e285d6 WatchSource:0}: Error finding container 1f184c5c2a51939c6b93397109be430e05cb3aef03a4c7ef936ed78302e285d6: Status 404 returned error can't find the container with id 1f184c5c2a51939c6b93397109be430e05cb3aef03a4c7ef936ed78302e285d6 Jul 09 18:03:42.079534 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:03:42.078953 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb765dd66_7175_4c20_a287_85756a566cad.slice/crio-a4c12f9bf92d1f36fd4b6c235e2f2f2db326156eff195a54116cbbda30969786 WatchSource:0}: Error finding container a4c12f9bf92d1f36fd4b6c235e2f2f2db326156eff195a54116cbbda30969786: Status 404 returned error can't find the container with id a4c12f9bf92d1f36fd4b6c235e2f2f2db326156eff195a54116cbbda30969786 Jul 09 18:03:42.556680 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.555832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:42.556680 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.556095 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:42.556680 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.556173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:42.556680 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.556189 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:44.556165934 +0000 UTC m=+6.013982452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:42.556680 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.556274 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:42.556680 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.556331 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:03:44.556314836 +0000 UTC m=+6.014131351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:42.656945 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:42.656898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:42.657203 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.657118 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:03:42.657203 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.657141 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:03:42.657203 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.657155 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:42.657401 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:42.657216 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:44.657198353 +0000 UTC m=+6.115014869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:43.006345 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.006216 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:58:41 +0000 UTC" deadline="2028-04-13 19:50:56.407227288 +0000 UTC" Jul 09 18:03:43.006345 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.006290 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15457h47m13.400942004s" Jul 09 18:03:43.091819 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.091778 2564 generic.go:356] "Generic (PLEG): container finished" podID="f507c596cc52138e28220f2146c8bfd0" containerID="7dd8174b49a30bc3cebebfd685e990cb5797ad938b2a5c806babb44ed1d80e0e" exitCode=0 Jul 09 18:03:43.092030 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.091879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" event={"ID":"f507c596cc52138e28220f2146c8bfd0","Type":"ContainerDied","Data":"7dd8174b49a30bc3cebebfd685e990cb5797ad938b2a5c806babb44ed1d80e0e"} Jul 09 18:03:43.098147 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.098108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" event={"ID":"bb30feae-bed2-4d73-9ae1-da99c55e18d6","Type":"ContainerStarted","Data":"4c0234c2f7c57e7d15a2af0998b036af93bad4e7b76ce457940a1b35bcb32955"} Jul 09 18:03:43.107875 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.107633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" event={"ID":"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9","Type":"ContainerStarted","Data":"0d7a8e2158107d8f8b24b2a8655c0d00c9535a57936e64fc4b319df1eb596d07"} Jul 09 18:03:43.112976 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.112944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-spsr7" event={"ID":"0fe86208-9ae2-477c-b7f4-7d75baff8104","Type":"ContainerStarted","Data":"ccbc3d93a1947209ec04f37721c7a9038045853e9940b27d075d46467ccae195"} Jul 09 18:03:43.119057 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.118980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmbxn" event={"ID":"745e7b74-43a1-48c1-bb51-2cfce52bbfb5","Type":"ContainerStarted","Data":"1f184c5c2a51939c6b93397109be430e05cb3aef03a4c7ef936ed78302e285d6"} Jul 09 18:03:43.132579 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.132463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerStarted","Data":"55d6609df9553a867573b736d5566acc1bbad7495b2577cc1eb32cb09d6534cb"} Jul 09 18:03:43.149498 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.149460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" event={"ID":"461a8c1189d3fa14a8ddfb5e1ff91d87","Type":"ContainerStarted","Data":"1aca9396d2a98d01adca7c64490f6f7d801edf2c9c7e0c3a6854064180f4663e"} Jul 09 18:03:43.161491 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.161378 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"73fdb1ec9ae2ec9e559fb751194301bf250a9acef9e69847d3a54d2cb4044f12"} Jul 09 18:03:43.176116 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.176069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b29jj" event={"ID":"b765dd66-7175-4c20-a287-85756a566cad","Type":"ContainerStarted","Data":"a4c12f9bf92d1f36fd4b6c235e2f2f2db326156eff195a54116cbbda30969786"} Jul 09 18:03:43.185839 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:43.185799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b2qzt" event={"ID":"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6","Type":"ContainerStarted","Data":"a879e93d1ac7017c3f15deb5894670c7d883b477b59bc408767692544c206367"} Jul 09 18:03:44.056659 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.056628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:44.057247 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.056758 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:44.057247 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.056839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:44.057247 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.056925 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:44.057247 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.056980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:44.057533 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.057502 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:44.211227 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.211129 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" event={"ID":"f507c596cc52138e28220f2146c8bfd0","Type":"ContainerStarted","Data":"ee361c094f7fa3d268c90af7cf0d4312e2d9e285e95413c3622da1a01f354457"} Jul 09 18:03:44.236924 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.236118 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" podStartSLOduration=3.236075337 podStartE2EDuration="3.236075337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:03:43.203205442 +0000 UTC m=+4.661021971" watchObservedRunningTime="2026-07-09 18:03:44.236075337 +0000 UTC m=+5.693891873" Jul 09 18:03:44.236924 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.236222 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" podStartSLOduration=3.236214046 podStartE2EDuration="3.236214046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:03:44.23570154 +0000 UTC m=+5.693518075" watchObservedRunningTime="2026-07-09 18:03:44.236214046 +0000 UTC m=+5.694030583" Jul 09 18:03:44.571948 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.571907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:44.572169 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.572014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:44.572169 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.572092 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:44.572310 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.572168 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:44.572310 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.572186 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:48.572162134 +0000 UTC m=+10.029978654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:44.572310 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.572223 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:03:48.572207064 +0000 UTC m=+10.030023578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:44.672527 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:44.672480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:44.672803 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.672782 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:03:44.672889 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.672811 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:03:44.672889 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.672821 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:44.672889 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:44.672888 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:48.672865624 +0000 UTC m=+10.130682160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:46.056550 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:46.056511 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:46.057033 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:46.056660 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:46.057249 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:46.057228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:46.057371 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:46.057345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:46.057441 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:46.057425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:46.057646 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:46.057620 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:48.056736 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:48.056639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:48.056736 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:48.056678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:48.057321 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:48.056655 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:48.057321 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.056807 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:48.057321 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.056903 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:48.057321 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.056996 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:48.611341 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:48.611297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:48.611563 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:48.611377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:48.611563 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.611479 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:48.611563 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.611483 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:48.611563 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.611548 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:56.611528275 +0000 UTC m=+18.069344801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:48.611563 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.611567 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:03:56.611558235 +0000 UTC m=+18.069374748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:48.712064 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:48.712016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:48.712268 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.712222 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:03:48.712268 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.712243 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:03:48.712268 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.712256 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:48.712430 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:48.712320 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:03:56.712299093 +0000 UTC m=+18.170115606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:50.056948 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:50.056894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:50.056948 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:50.056928 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:50.056948 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:50.056963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:50.057650 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:50.057047 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:50.057650 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:50.057116 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:50.057650 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:50.057149 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:52.056518 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:52.056482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:52.056990 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:52.056617 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:52.056990 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:52.056483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:52.056990 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:52.056739 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:52.056990 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:52.056483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:52.056990 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:52.056815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:54.057319 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:54.057243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:54.057794 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:54.057242 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:54.057794 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:54.057362 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:54.057794 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:54.057394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:54.057794 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:54.057491 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:54.057794 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:54.057579 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:56.056698 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:56.056663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:56.057237 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:56.056706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:56.057237 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:56.056706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:56.057237 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.056787 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:03:56.057237 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.056882 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:56.057237 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.056953 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:56.675516 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:56.675476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:56.675817 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:56.675546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:56.675817 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.675655 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:56.675817 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.675655 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:56.675817 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.675726 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:04:12.675706744 +0000 UTC m=+34.133523274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:03:56.675817 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.675747 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:12.675737535 +0000 UTC m=+34.133554048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:03:56.776499 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:56.776460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:56.776691 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.776668 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:03:56.776691 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.776690 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:03:56.776803 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.776706 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:56.776803 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:56.776770 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:12.776752242 +0000 UTC m=+34.234568753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:03:58.056774 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:58.056595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:03:58.056774 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:58.056638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:03:58.056774 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:03:58.056639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:03:58.056774 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:58.056725 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:03:58.057448 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:58.056827 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:03:58.057448 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:03:58.056905 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:00.056182 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:00.056146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:00.056182 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:00.056180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:00.056678 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:00.056272 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:00.056678 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:00.056293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:00.056678 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:00.056371 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:00.056678 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:00.056480 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:02.057130 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.056922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:02.057761 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.056938 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:02.057761 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:02.057214 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:02.057761 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.056977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:02.057761 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:02.057280 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:02.057761 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:02.057402 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:02.249562 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.249536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" event={"ID":"bb30feae-bed2-4d73-9ae1-da99c55e18d6","Type":"ContainerStarted","Data":"d9dd1b57eb6286261f9332f51fba2c16ad3cbe366ee29e55cd8890a29c9b286f"} Jul 09 18:04:02.250738 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.250718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" event={"ID":"3b2dae6c-a2aa-4e27-a5fb-2674e7d785c9","Type":"ContainerStarted","Data":"f0b6d084be0dacc97abd2eb732f1fa0b5ffd2ed5ee2124df51cc7eb9dcf79144"} Jul 09 18:04:02.252076 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.252053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-spsr7" event={"ID":"0fe86208-9ae2-477c-b7f4-7d75baff8104","Type":"ContainerStarted","Data":"cff57f6ea674a2d904aad50833dfb1749e449afee7a21562f2256c1d54f35dc5"} Jul 09 18:04:02.253373 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.253339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmbxn" event={"ID":"745e7b74-43a1-48c1-bb51-2cfce52bbfb5","Type":"ContainerStarted","Data":"7eff9c034c646292a5f66f62c0a8782662068db838b57c92f3444689ae9b16a4"} Jul 09 18:04:02.254900 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.254877 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7935b3f-a980-4103-bd54-e85a0510cd7f" containerID="beb91751059f410834633772c17d78cc5bbbfd18c719f4d93fcfea9debf83c47" exitCode=0 Jul 09 18:04:02.254995 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.254955 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerDied","Data":"beb91751059f410834633772c17d78cc5bbbfd18c719f4d93fcfea9debf83c47"} Jul 09 18:04:02.256476 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.256450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmw2x" event={"ID":"14256da0-5916-43c0-ad56-8ce687a9191d","Type":"ContainerStarted","Data":"f00da1c261ab60620b137d470a5e8e76e59bd8c509c65e7f1cf41746ecbdbc38"} Jul 09 18:04:02.258561 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.258533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:04:02.258892 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.258846 2564 generic.go:356] "Generic (PLEG): container finished" podID="932dba37-1789-4a2c-9a3b-91cdf3156045" containerID="8cf6c017a292b6c9d93a41cbc2645ed6224c60826f5b18ac5680798d2fc7ce3a" exitCode=1 Jul 09 18:04:02.258964 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.258909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"5caf7d961734284f4871694e96a1c767eed0fc0e702455c215d338d06165c4d2"} Jul 09 18:04:02.258964 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.258961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerDied","Data":"8cf6c017a292b6c9d93a41cbc2645ed6224c60826f5b18ac5680798d2fc7ce3a"} Jul 09 18:04:02.259111 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.258998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"14aefde9503aa2b745d7be93c806ef9761a1621b9884bd1e32226d5b06f29af3"} Jul 09 18:04:02.260310 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.260291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b2qzt" event={"ID":"0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6","Type":"ContainerStarted","Data":"4152bfb9d2ff506b4a09ec18549067b301e618a1c0b23bd9c4da7da2b72f1d0f"} Jul 09 18:04:02.285401 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.285352 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b2qzt" podStartSLOduration=2.610534458 podStartE2EDuration="22.285331849s" totalImagesPullingTime="19.674797391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:02.284688857 +0000 UTC m=+23.742505389" watchObservedRunningTime="2026-07-09 18:04:02.285331849 +0000 UTC m=+23.743148380" Jul 09 18:04:02.285534 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.285481 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jmqx8" podStartSLOduration=2.605237232 podStartE2EDuration="22.285477235s" totalImagesPullingTime="19.680240003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:02.268846721 +0000 UTC m=+23.726663252" watchObservedRunningTime="2026-07-09 18:04:02.285477235 +0000 UTC m=+23.743293766" Jul 09 18:04:02.305288 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.305135 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-spsr7" podStartSLOduration=2.569573969 podStartE2EDuration="22.305119031s" totalImagesPullingTime="19.735545062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:02.3049182 +0000 UTC m=+23.762734731" watchObservedRunningTime="2026-07-09 18:04:02.305119031 +0000 UTC m=+23.762935562" Jul 09 18:04:02.321107 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.321063 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dmbxn" podStartSLOduration=2.641942607 podStartE2EDuration="22.321048404s" totalImagesPullingTime="19.679105797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:02.320656724 +0000 UTC m=+23.778473249" watchObservedRunningTime="2026-07-09 18:04:02.321048404 +0000 UTC m=+23.778864936" Jul 09 18:04:02.341599 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:02.341553 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kmw2x" podStartSLOduration=2.650833635 podStartE2EDuration="22.341538506s" totalImagesPullingTime="19.690704871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:02.341259 +0000 UTC m=+23.799075532" watchObservedRunningTime="2026-07-09 18:04:02.341538506 +0000 UTC m=+23.799355038" Jul 09 18:04:03.265706 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.265631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:04:03.266378 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.266107 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"4180f682a3cd05b97d05761aaf5de87480af37d2ef56d723f42a261297ce3811"} Jul 09 18:04:03.266378 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.266194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"028465c39bf248f561fb24f2bc777e9a713cd347206c486ae3fe1061abfa40bf"} Jul 09 18:04:03.266378 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.266250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"e23712b0db017cf048c39aadf2a67310e19134776dfc32f7850022b6f9b13c3b"} Jul 09 18:04:03.983556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.983447 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 18:04:03.993134 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.993017 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:04:03.983465784Z","UUID":"92c724ff-070f-4c32-87d8-ab1974d314d4","Handler":null,"Name":"","Endpoint":""} Jul 09 18:04:03.994519 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.994501 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 18:04:03.994648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:03.994535 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 18:04:04.056385 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:04.056346 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:04.056385 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:04.056367 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:04.056639 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:04.056464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:04.056639 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:04.056470 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:04.056639 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:04.056537 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:04.056639 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:04.056612 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:04.270957 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:04.270871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" event={"ID":"bb30feae-bed2-4d73-9ae1-da99c55e18d6","Type":"ContainerStarted","Data":"27f184ff43f508d1f02da01b598144a24da8d8a666844a9f0fa55fea2d9d830d"} Jul 09 18:04:04.272545 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:04.272515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b29jj" event={"ID":"b765dd66-7175-4c20-a287-85756a566cad","Type":"ContainerStarted","Data":"e65ee18201700d002caad83f4be7887afbbb75ac9b75aba113b2ea89389a0605"} Jul 09 18:04:05.277863 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:05.277706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:04:05.278329 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:05.278225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"3cab22ec3197748b319a8a6a29e73fecb2c7c85611c86295c250ff26444aa165"} Jul 09 18:04:06.056334 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:06.056302 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:06.056566 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:06.056423 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:06.056566 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:06.056535 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:06.056566 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:06.056426 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:06.056734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:06.056584 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:06.056734 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:06.056677 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:06.597743 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:06.597699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:04:06.598342 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:06.598323 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:04:06.616042 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:06.615980 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b29jj" podStartSLOduration=6.943851308 podStartE2EDuration="26.615964839s" totalImagesPullingTime="19.672113531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:04.291717327 +0000 UTC m=+25.749533859" watchObservedRunningTime="2026-07-09 18:04:06.615964839 +0000 UTC m=+28.073781370" Jul 09 18:04:07.284325 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.284138 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7935b3f-a980-4103-bd54-e85a0510cd7f" containerID="73f270ea4ebf98fdb51f1b5fba90a4801ebedee415167fd2bfb08004f0fb4402" exitCode=0 Jul 09 18:04:07.284491 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.284221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerDied","Data":"73f270ea4ebf98fdb51f1b5fba90a4801ebedee415167fd2bfb08004f0fb4402"} Jul 09 18:04:07.287831 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.287810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:04:07.288273 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.288248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"97dc1129fc1d7fc96b2a839308769ce7ba6528fbe2d984a0e4833af83c28640c"} Jul 09 18:04:07.288508 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.288492 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:04:07.288699 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.288685 2564 scope.go:117] "RemoveContainer" containerID="8cf6c017a292b6c9d93a41cbc2645ed6224c60826f5b18ac5680798d2fc7ce3a" Jul 09 18:04:07.290630 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.290600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" event={"ID":"bb30feae-bed2-4d73-9ae1-da99c55e18d6","Type":"ContainerStarted","Data":"1f69be07396d3f398a04cebc6e603a3f11c2c030bddf947557eaeee32900a992"} Jul 09 18:04:07.290836 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.290823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:04:07.291340 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.291322 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b2qzt" Jul 09 18:04:07.305839 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.305815 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:04:07.341653 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:07.341606 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5tt" podStartSLOduration=3.944696782 podStartE2EDuration="28.341590705s" totalImagesPullingTime="24.396893923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:07.340604958 +0000 UTC m=+28.798421490" watchObservedRunningTime="2026-07-09 18:04:07.341590705 +0000 UTC m=+28.799407236" Jul 09 18:04:08.056845 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.056811 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:08.056845 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.056856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:08.057593 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.056856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:08.057593 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:08.056936 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:08.057593 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:08.057061 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:08.057593 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:08.057146 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:08.296815 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.296749 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:04:08.297144 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.297120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" event={"ID":"932dba37-1789-4a2c-9a3b-91cdf3156045","Type":"ContainerStarted","Data":"753f3dc2638b78e0f11bebc79bee7c31da214daf0aa5937c1e78a945febcb870"} Jul 09 18:04:08.297514 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.297495 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:04:08.297597 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.297566 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:04:08.313007 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.312979 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:04:08.328126 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:08.328084 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" podStartSLOduration=8.598875917 podStartE2EDuration="28.328069839s" totalImagesPullingTime="19.729193922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:08.326984409 +0000 UTC m=+29.784800942" watchObservedRunningTime="2026-07-09 18:04:08.328069839 +0000 UTC m=+29.785886370" Jul 09 18:04:09.018251 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.018154 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kjwj7"] Jul 09 18:04:09.018524 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.018332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:09.018524 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:09.018438 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:09.019016 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.018994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cg4q9"] Jul 09 18:04:09.019136 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.019098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:09.019205 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:09.019187 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:09.019696 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.019662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vgxd7"] Jul 09 18:04:09.019816 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.019775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:09.019901 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:09.019876 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:09.302179 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.302088 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7935b3f-a980-4103-bd54-e85a0510cd7f" containerID="2c1d51888435ebb161016b78c8cb485b948274837a6dc5c7de0a4169fdf42269" exitCode=0 Jul 09 18:04:09.302665 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:09.302173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerDied","Data":"2c1d51888435ebb161016b78c8cb485b948274837a6dc5c7de0a4169fdf42269"} Jul 09 18:04:11.057280 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:11.057245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:11.057280 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:11.057262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:11.057841 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:11.057395 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:11.057841 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:11.057471 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:11.057841 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:11.057519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:11.057841 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:11.057657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:11.308931 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:11.308753 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7935b3f-a980-4103-bd54-e85a0510cd7f" containerID="d9da4de61b4aeec5f16ced83520c296fb220b5d5d5c8f672a32295b04e680035" exitCode=0 Jul 09 18:04:11.308931 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:11.308812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerDied","Data":"d9da4de61b4aeec5f16ced83520c296fb220b5d5d5c8f672a32295b04e680035"} Jul 09 18:04:12.693274 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:12.693234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:12.693786 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:12.693305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:12.693786 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.693427 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:04:12.693786 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.693430 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:04:12.693786 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.693498 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret podName:dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa nodeName:}" failed. No retries permitted until 2026-07-09 18:04:44.693479252 +0000 UTC m=+66.151295764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret") pod "global-pull-secret-syncer-cg4q9" (UID: "dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:04:12.693786 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.693517 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:44.693509043 +0000 UTC m=+66.151325555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:04:12.793876 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:12.793835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:12.794083 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.793975 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:04:12.794083 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.793990 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:04:12.794083 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.793999 2564 projected.go:196] Error preparing data for projected volume kube-api-access-88lgh for pod openshift-network-diagnostics/network-check-target-kjwj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:04:12.794083 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:12.794071 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh podName:ba307fab-e4c6-4429-a6e0-feb3f2b474e2 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:44.794054566 +0000 UTC m=+66.251871077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-88lgh" (UniqueName: "kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh") pod "network-check-target-kjwj7" (UID: "ba307fab-e4c6-4429-a6e0-feb3f2b474e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:04:13.057399 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:13.056817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:13.057399 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:13.056879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:13.057399 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:13.056973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:13.057399 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:13.056975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cg4q9" podUID="dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa" Jul 09 18:04:13.057399 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:13.057073 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kjwj7" podUID="ba307fab-e4c6-4429-a6e0-feb3f2b474e2" Jul 09 18:04:13.057399 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:13.057162 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgxd7" podUID="b1ee9cce-c279-478f-8ca0-dd6bae1ad007" Jul 09 18:04:14.330641 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.330605 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeReady" Jul 09 18:04:14.331177 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.330791 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 18:04:14.370993 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.370162 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58fbbddf8d-qcbgd"] Jul 09 18:04:14.372308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.372278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.374950 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.374925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 18:04:14.374950 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.374947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vsp6r\"" Jul 09 18:04:14.375166 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.374925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 18:04:14.375443 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.375294 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 18:04:14.381719 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.381693 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 18:04:14.395121 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.395088 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-phqc7"] Jul 09 18:04:14.397284 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.397262 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58fbbddf8d-qcbgd"] Jul 09 18:04:14.397284 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.397291 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqzxk"] Jul 09 18:04:14.397478 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.397401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.398961 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.398939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.400903 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.400884 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 18:04:14.400903 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.400894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 18:04:14.401052 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.400949 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h78nz\"" Jul 09 18:04:14.401461 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.401442 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 18:04:14.401834 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.401814 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 18:04:14.401834 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.401834 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 18:04:14.402062 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.401841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzs4d\"" Jul 09 18:04:14.410829 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.410795 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phqc7"] Jul 09 18:04:14.410948 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.410879 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqzxk"] Jul 09 18:04:14.505469 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.505469 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f048dafc-a792-420c-bf53-c158974e1ca9-cert\") pod \"ingress-canary-mqzxk\" (UID: \"f048dafc-a792-420c-bf53-c158974e1ca9\") " pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb72w\" (UniqueName: \"kubernetes.io/projected/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-kube-api-access-kb72w\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-bound-sa-token\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhjd\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-kube-api-access-djhjd\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-trusted-ca\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-installation-pull-secrets\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505694 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-image-registry-private-configuration\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505995 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rkn\" (UniqueName: \"kubernetes.io/projected/f048dafc-a792-420c-bf53-c158974e1ca9-kube-api-access-j9rkn\") pod \"ingress-canary-mqzxk\" (UID: \"f048dafc-a792-420c-bf53-c158974e1ca9\") " pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.505995 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f91815e-16fc-46c5-803c-69d17edf90c9-ca-trust-extracted\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505995 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-certificates\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.505995 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-config-volume\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.505995 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.505847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-tmp-dir\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.606750 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb72w\" (UniqueName: \"kubernetes.io/projected/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-kube-api-access-kb72w\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.606750 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-bound-sa-token\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhjd\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-kube-api-access-djhjd\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-trusted-ca\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-installation-pull-secrets\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-image-registry-private-configuration\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rkn\" (UniqueName: \"kubernetes.io/projected/f048dafc-a792-420c-bf53-c158974e1ca9-kube-api-access-j9rkn\") pod \"ingress-canary-mqzxk\" (UID: \"f048dafc-a792-420c-bf53-c158974e1ca9\") " pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f91815e-16fc-46c5-803c-69d17edf90c9-ca-trust-extracted\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.606992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-certificates\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607014 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-config-volume\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-tmp-dir\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f048dafc-a792-420c-bf53-c158974e1ca9-cert\") pod \"ingress-canary-mqzxk\" (UID: \"f048dafc-a792-420c-bf53-c158974e1ca9\") " pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:14.607247 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:14.607258 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:14.607440 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:14.607302 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:15.107284955 +0000 UTC m=+36.565101482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:14.607736 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607573 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f91815e-16fc-46c5-803c-69d17edf90c9-ca-trust-extracted\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607736 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-certificates\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607736 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:14.607700 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:14.607880 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:14.607776 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:04:15.107758148 +0000 UTC m=+36.565574699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:14.607941 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607894 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-trusted-ca\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.607941 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607922 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-tmp-dir\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.608059 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.607963 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-config-volume\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.611724 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.611697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-image-registry-private-configuration\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.611846 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.611701 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f048dafc-a792-420c-bf53-c158974e1ca9-cert\") pod \"ingress-canary-mqzxk\" (UID: \"f048dafc-a792-420c-bf53-c158974e1ca9\") " pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.612338 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.612314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-installation-pull-secrets\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.617491 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.617467 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhjd\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-kube-api-access-djhjd\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.617754 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.617734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb72w\" (UniqueName: \"kubernetes.io/projected/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-kube-api-access-kb72w\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:14.618406 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.618384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rkn\" (UniqueName: \"kubernetes.io/projected/f048dafc-a792-420c-bf53-c158974e1ca9-kube-api-access-j9rkn\") pod \"ingress-canary-mqzxk\" (UID: \"f048dafc-a792-420c-bf53-c158974e1ca9\") " pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:14.618472 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.618427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-bound-sa-token\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:14.716783 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:14.716747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqzxk" Jul 09 18:04:15.056471 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.056428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:15.056667 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.056428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:15.056667 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.056433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:15.059633 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.059607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 18:04:15.059776 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.059686 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdjws\"" Jul 09 18:04:15.060646 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.060624 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 18:04:15.060791 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.060652 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 18:04:15.060791 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.060673 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ws4d4\"" Jul 09 18:04:15.060791 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.060625 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 18:04:15.110937 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.110901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:15.111140 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.110968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:15.111140 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:15.111100 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:15.111247 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:15.111139 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:15.111247 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:15.111153 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:15.111247 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:15.111187 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:04:16.111166204 +0000 UTC m=+37.568982732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:15.111247 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:15.111219 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:16.111200766 +0000 UTC m=+37.569017297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:15.117850 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.117806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:15.247803 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.247769 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:15.349103 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.348996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:15.449558 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.449523 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:15.549891 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:15.549850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:16.068924 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.068751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:16.084619 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.084568 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqzxk"] Jul 09 18:04:16.088314 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:16.088269 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf048dafc_a792_420c_bf53_c158974e1ca9.slice/crio-2b55ca527049c3beddbaf73adc802b352b52a1a0e044e738dc471908d35e33ae WatchSource:0}: Error finding container 2b55ca527049c3beddbaf73adc802b352b52a1a0e044e738dc471908d35e33ae: Status 404 returned error can't find the container with id 2b55ca527049c3beddbaf73adc802b352b52a1a0e044e738dc471908d35e33ae Jul 09 18:04:16.118919 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.118885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:16.119042 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.118935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:16.119090 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:16.119051 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:16.119128 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:16.119116 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:04:18.119101469 +0000 UTC m=+39.576917982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:16.119170 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:16.119055 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:16.119170 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:16.119153 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:16.119234 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:16.119202 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:18.119187526 +0000 UTC m=+39.577004063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:16.170173 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.170144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:16.324100 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.324065 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7935b3f-a980-4103-bd54-e85a0510cd7f" containerID="9833b47d699bdaf6a2555880c206f9e7fad47f65abce0e9b7c00fe43f0d1ecb1" exitCode=0 Jul 09 18:04:16.324284 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.324141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerDied","Data":"9833b47d699bdaf6a2555880c206f9e7fad47f65abce0e9b7c00fe43f0d1ecb1"} Jul 09 18:04:16.325294 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.325267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqzxk" event={"ID":"f048dafc-a792-420c-bf53-c158974e1ca9","Type":"ContainerStarted","Data":"2b55ca527049c3beddbaf73adc802b352b52a1a0e044e738dc471908d35e33ae"} Jul 09 18:04:16.474271 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.474178 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:16.546941 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:16.546897 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:17.286149 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:17.286113 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:17.331077 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:17.331045 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7935b3f-a980-4103-bd54-e85a0510cd7f" containerID="944791129e995abc0ac0bab810e988329eebef0b73274aebf9e02598649dd386" exitCode=0 Jul 09 18:04:17.331269 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:17.331122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerDied","Data":"944791129e995abc0ac0bab810e988329eebef0b73274aebf9e02598649dd386"} Jul 09 18:04:17.370559 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:17.370499 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:17.675321 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:17.675287 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:17.776274 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:17.776241 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:18.135585 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:18.135544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:18.135779 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:18.135654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:18.135779 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:18.135739 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:18.135779 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:18.135752 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:18.135779 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:18.135761 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:18.135912 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:18.135801 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:04:22.13578827 +0000 UTC m=+43.593604780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:18.135912 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:18.135815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:22.135808171 +0000 UTC m=+43.593624681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:18.342537 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:18.342322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" event={"ID":"a7935b3f-a980-4103-bd54-e85a0510cd7f","Type":"ContainerStarted","Data":"b432c10dc3367e4e3a74a38406d0b7ef06e301e8838e8b9ac0da1b249759969e"} Jul 09 18:04:18.370359 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:18.370293 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pvjtn" podStartSLOduration=6.735037546 podStartE2EDuration="38.370270354s" totalImagesPullingTime="31.635232808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:18.368317991 +0000 UTC m=+39.826134526" watchObservedRunningTime="2026-07-09 18:04:18.370270354 +0000 UTC m=+39.828086888" Jul 09 18:04:18.602002 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:18.601973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:18.703347 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:18.703309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:19.123151 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:19.123116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:19.214921 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:19.214848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:19.346506 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:19.346465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqzxk" event={"ID":"f048dafc-a792-420c-bf53-c158974e1ca9","Type":"ContainerStarted","Data":"aee5cbf4cce276cec7da3e04a467fe1561adb89c477ab6a839a9530959c5cd3b"} Jul 09 18:04:19.374009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:19.373906 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqzxk" podStartSLOduration=3.201332444 podStartE2EDuration="5.373888169s" totalImagesPullingTime="2.172555725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:19.373387796 +0000 UTC m=+40.831204328" watchObservedRunningTime="2026-07-09 18:04:19.373888169 +0000 UTC m=+40.831704698" Jul 09 18:04:20.617788 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:20.617755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:20.700327 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:20.700295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:22.166467 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:22.166431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:22.166878 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:22.166481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:22.166878 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:22.166584 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:22.166878 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:22.166585 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:22.166878 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:22.166595 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:22.166878 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:22.166660 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:04:30.16663814 +0000 UTC m=+51.624454673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:22.166878 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:22.166678 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:30.166671298 +0000 UTC m=+51.624487847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:22.883248 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:22.883209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:22.978776 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:22.978732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:23.441733 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:23.441701 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:23.518240 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:23.518208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:30.229440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:30.229398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:30.229936 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:30.229453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:30.229936 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:30.229549 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:30.229936 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:30.229551 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:30.229936 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:30.229613 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:04:46.229597481 +0000 UTC m=+67.687413991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:30.229936 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:30.229560 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:30.229936 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:30.229691 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:46.229678648 +0000 UTC m=+67.687495158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:31.513673 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:31.513636 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:31.570446 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:31.570407 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:34.020690 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.020657 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m"] Jul 09 18:04:34.041290 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.041257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m"] Jul 09 18:04:34.041471 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.041368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.047242 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.047212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 18:04:34.047406 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.047255 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 18:04:34.047406 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.047256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hk88r\"" Jul 09 18:04:34.047406 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.047273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 18:04:34.047673 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.047651 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 18:04:34.131224 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.131189 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl"] Jul 09 18:04:34.133184 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.133159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.137267 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.137244 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 18:04:34.137457 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.137438 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7dgl8\"" Jul 09 18:04:34.137545 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.137523 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 18:04:34.137839 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.137818 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:04:34.137919 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.137841 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 18:04:34.148879 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.148839 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-4d5dr"] Jul 09 18:04:34.152510 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.152481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.156814 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.156765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rlsb6\"" Jul 09 18:04:34.157011 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.156838 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 18:04:34.157011 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.156865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 18:04:34.157011 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.156901 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:04:34.157011 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.156914 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 18:04:34.160906 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.160885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.161009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.160924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ns6c\" (UniqueName: \"kubernetes.io/projected/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-kube-api-access-9ns6c\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.161009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.160950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.165223 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.165194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl"] Jul 09 18:04:34.168925 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.168899 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 18:04:34.183324 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.183294 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59"] Jul 09 18:04:34.185129 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.185107 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" Jul 09 18:04:34.191056 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.191005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pm5z2\"" Jul 09 18:04:34.205253 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.205221 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4d5dr"] Jul 09 18:04:34.213278 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.213244 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59"] Jul 09 18:04:34.251973 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.251938 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf"] Jul 09 18:04:34.254115 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.254096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" Jul 09 18:04:34.256850 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.256826 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:04:34.256953 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.256920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x6kd6\"" Jul 09 18:04:34.257376 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.257356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 18:04:34.261255 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ns6c\" (UniqueName: \"kubernetes.io/projected/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-kube-api-access-9ns6c\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.261346 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.261346 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp9hk\" (UniqueName: \"kubernetes.io/projected/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-kube-api-access-cp9hk\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.261346 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e14-0910-41bb-be1f-fa93cf179551-serving-cert\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.261481 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a53b6e14-0910-41bb-be1f-fa93cf179551-config\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.261598 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.261669 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.261725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.261780 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjn4\" (UniqueName: \"kubernetes.io/projected/a53b6e14-0910-41bb-be1f-fa93cf179551-kube-api-access-dnjn4\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.261780 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:34.261741 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:34.261780 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.261763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e14-0910-41bb-be1f-fa93cf179551-trusted-ca\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.261881 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:34.261823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls podName:f2fbc9b3-0689-47f0-85ae-55ea6a4c1020 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:34.761801349 +0000 UTC m=+56.219617874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bdk7m" (UID: "f2fbc9b3-0689-47f0-85ae-55ea6a4c1020") : secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:34.262061 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.262021 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.286153 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.286061 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf"] Jul 09 18:04:34.292244 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.292210 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ns6c\" (UniqueName: \"kubernetes.io/projected/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-kube-api-access-9ns6c\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.362163 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.362343 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.362343 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjn4\" (UniqueName: \"kubernetes.io/projected/a53b6e14-0910-41bb-be1f-fa93cf179551-kube-api-access-dnjn4\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.362343 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47jn\" (UniqueName: \"kubernetes.io/projected/f3d7826c-3cde-4b9f-bbaa-7655d1fc842c-kube-api-access-t47jn\") pod \"volume-data-source-validator-78495597f6-6nrmf\" (UID: \"f3d7826c-3cde-4b9f-bbaa-7655d1fc842c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" Jul 09 18:04:34.362497 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e14-0910-41bb-be1f-fa93cf179551-trusted-ca\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.362547 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74b59\" (UniqueName: \"kubernetes.io/projected/605e9e1a-6f24-4886-846b-d3defa7aa69a-kube-api-access-74b59\") pod \"network-check-source-869dcfcdcd-mmn59\" (UID: \"605e9e1a-6f24-4886-846b-d3defa7aa69a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" Jul 09 18:04:34.362595 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp9hk\" (UniqueName: \"kubernetes.io/projected/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-kube-api-access-cp9hk\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.362641 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e14-0910-41bb-be1f-fa93cf179551-serving-cert\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.362641 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a53b6e14-0910-41bb-be1f-fa93cf179551-config\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.362751 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.362739 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.363203 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.363178 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a53b6e14-0910-41bb-be1f-fa93cf179551-config\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.363310 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.363252 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e14-0910-41bb-be1f-fa93cf179551-trusted-ca\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.364546 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.364528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.364886 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.364869 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e14-0910-41bb-be1f-fa93cf179551-serving-cert\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.381274 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.381242 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp9hk\" (UniqueName: \"kubernetes.io/projected/7e4ee00e-9f1a-4083-95c8-601ce2c001f8-kube-api-access-cp9hk\") pod \"kube-storage-version-migrator-operator-799cb7f958-pd4tl\" (UID: \"7e4ee00e-9f1a-4083-95c8-601ce2c001f8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.381418 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.381401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjn4\" (UniqueName: \"kubernetes.io/projected/a53b6e14-0910-41bb-be1f-fa93cf179551-kube-api-access-dnjn4\") pod \"console-operator-7866497494-4d5dr\" (UID: \"a53b6e14-0910-41bb-be1f-fa93cf179551\") " pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.425528 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.425483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:34.442304 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.442277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" Jul 09 18:04:34.461100 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.461072 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:34.463157 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.463131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47jn\" (UniqueName: \"kubernetes.io/projected/f3d7826c-3cde-4b9f-bbaa-7655d1fc842c-kube-api-access-t47jn\") pod \"volume-data-source-validator-78495597f6-6nrmf\" (UID: \"f3d7826c-3cde-4b9f-bbaa-7655d1fc842c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" Jul 09 18:04:34.463293 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.463171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74b59\" (UniqueName: \"kubernetes.io/projected/605e9e1a-6f24-4886-846b-d3defa7aa69a-kube-api-access-74b59\") pod \"network-check-source-869dcfcdcd-mmn59\" (UID: \"605e9e1a-6f24-4886-846b-d3defa7aa69a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" Jul 09 18:04:34.474332 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.474309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47jn\" (UniqueName: \"kubernetes.io/projected/f3d7826c-3cde-4b9f-bbaa-7655d1fc842c-kube-api-access-t47jn\") pod \"volume-data-source-validator-78495597f6-6nrmf\" (UID: \"f3d7826c-3cde-4b9f-bbaa-7655d1fc842c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" Jul 09 18:04:34.476371 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.476344 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74b59\" (UniqueName: \"kubernetes.io/projected/605e9e1a-6f24-4886-846b-d3defa7aa69a-kube-api-access-74b59\") pod \"network-check-source-869dcfcdcd-mmn59\" (UID: \"605e9e1a-6f24-4886-846b-d3defa7aa69a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" Jul 09 18:04:34.494164 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.494132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" Jul 09 18:04:34.508732 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.508537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:34.563484 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.563451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" Jul 09 18:04:34.584931 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.584899 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl"] Jul 09 18:04:34.588133 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:34.588108 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4ee00e_9f1a_4083_95c8_601ce2c001f8.slice/crio-1a088d2509ed5a6cdfbfafbdc446168269d1985db34881c47ec92b5e3e4e9a23 WatchSource:0}: Error finding container 1a088d2509ed5a6cdfbfafbdc446168269d1985db34881c47ec92b5e3e4e9a23: Status 404 returned error can't find the container with id 1a088d2509ed5a6cdfbfafbdc446168269d1985db34881c47ec92b5e3e4e9a23 Jul 09 18:04:34.615597 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:34.615568 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53b6e14_0910_41bb_be1f_fa93cf179551.slice/crio-3462cb4030aa6e46ce1a64862b8ba4217732e84b1092a8cb24e0a75acc390720 WatchSource:0}: Error finding container 3462cb4030aa6e46ce1a64862b8ba4217732e84b1092a8cb24e0a75acc390720: Status 404 returned error can't find the container with id 3462cb4030aa6e46ce1a64862b8ba4217732e84b1092a8cb24e0a75acc390720 Jul 09 18:04:34.626324 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.626298 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4d5dr"] Jul 09 18:04:34.668368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.668334 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59"] Jul 09 18:04:34.671262 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:34.671221 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605e9e1a_6f24_4886_846b_d3defa7aa69a.slice/crio-0cccc87fd4b22251768c75fef36962e82fd0505d25e12839238db9913952ad9a WatchSource:0}: Error finding container 0cccc87fd4b22251768c75fef36962e82fd0505d25e12839238db9913952ad9a: Status 404 returned error can't find the container with id 0cccc87fd4b22251768c75fef36962e82fd0505d25e12839238db9913952ad9a Jul 09 18:04:34.713098 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.713068 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf"] Jul 09 18:04:34.716702 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:34.716677 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d7826c_3cde_4b9f_bbaa_7655d1fc842c.slice/crio-83fa8646eb6889800845578673881e6ec3f6efc78324ad66c32b481e9131c2f8 WatchSource:0}: Error finding container 83fa8646eb6889800845578673881e6ec3f6efc78324ad66c32b481e9131c2f8: Status 404 returned error can't find the container with id 83fa8646eb6889800845578673881e6ec3f6efc78324ad66c32b481e9131c2f8 Jul 09 18:04:34.765437 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:34.765401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:34.765626 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:34.765528 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:34.765626 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:34.765581 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls podName:f2fbc9b3-0689-47f0-85ae-55ea6a4c1020 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:35.765567167 +0000 UTC m=+57.223383678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bdk7m" (UID: "f2fbc9b3-0689-47f0-85ae-55ea6a4c1020") : secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:35.204525 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.204488 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:35.304978 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.304920 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:35.386918 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.386842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" event={"ID":"605e9e1a-6f24-4886-846b-d3defa7aa69a","Type":"ContainerStarted","Data":"0cccc87fd4b22251768c75fef36962e82fd0505d25e12839238db9913952ad9a"} Jul 09 18:04:35.389134 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.389102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" event={"ID":"f3d7826c-3cde-4b9f-bbaa-7655d1fc842c","Type":"ContainerStarted","Data":"83fa8646eb6889800845578673881e6ec3f6efc78324ad66c32b481e9131c2f8"} Jul 09 18:04:35.391565 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.391524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" event={"ID":"7e4ee00e-9f1a-4083-95c8-601ce2c001f8","Type":"ContainerStarted","Data":"1a088d2509ed5a6cdfbfafbdc446168269d1985db34881c47ec92b5e3e4e9a23"} Jul 09 18:04:35.394737 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.394669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4d5dr" event={"ID":"a53b6e14-0910-41bb-be1f-fa93cf179551","Type":"ContainerStarted","Data":"3462cb4030aa6e46ce1a64862b8ba4217732e84b1092a8cb24e0a75acc390720"} Jul 09 18:04:35.776540 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:35.776439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:35.776703 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:35.776689 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:35.776869 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:35.776761 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls podName:f2fbc9b3-0689-47f0-85ae-55ea6a4c1020 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:37.776741357 +0000 UTC m=+59.234557883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bdk7m" (UID: "f2fbc9b3-0689-47f0-85ae-55ea6a4c1020") : secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:36.399958 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:36.399857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" event={"ID":"f3d7826c-3cde-4b9f-bbaa-7655d1fc842c","Type":"ContainerStarted","Data":"20c922d6adf91478129114c5028481043db7cbf029e1230b8d6da4f3c0474db5"} Jul 09 18:04:36.421399 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:36.421318 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6nrmf" podStartSLOduration=1.026419237 podStartE2EDuration="2.421293068s" totalImagesPullingTime="1.394873831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:36.419662022 +0000 UTC m=+57.877478555" watchObservedRunningTime="2026-07-09 18:04:36.421293068 +0000 UTC m=+57.879109602" Jul 09 18:04:36.568603 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:36.568504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:36.675534 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:36.675362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:37.312527 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.312489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:37.389555 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.389518 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hjwm6"] Jul 09 18:04:37.391607 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.391580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.395771 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.395742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 18:04:37.395919 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.395797 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 18:04:37.397103 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.397076 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 18:04:37.397211 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.397129 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sqrc5\"" Jul 09 18:04:37.397211 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.397164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 18:04:37.413516 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.413481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjwm6"] Jul 09 18:04:37.470415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.470378 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:37.493671 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.493631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.493860 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.493731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58ac4df2-1383-4bda-bf96-d7c33a9b195a-data-volume\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.493860 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.493779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqf6\" (UniqueName: \"kubernetes.io/projected/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-api-access-ptqf6\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.493979 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.493863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58ac4df2-1383-4bda-bf96-d7c33a9b195a-crio-socket\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.493979 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.493923 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595178 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595178 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58ac4df2-1383-4bda-bf96-d7c33a9b195a-data-volume\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595404 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:37.595216 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 18:04:37.595404 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:37.595316 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:38.095294539 +0000 UTC m=+59.553111072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : configmap "kube-rbac-proxy" not found Jul 09 18:04:37.595404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqf6\" (UniqueName: \"kubernetes.io/projected/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-api-access-ptqf6\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595555 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595413 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58ac4df2-1383-4bda-bf96-d7c33a9b195a-crio-socket\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595555 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595555 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595521 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58ac4df2-1383-4bda-bf96-d7c33a9b195a-crio-socket\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595681 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.595568 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58ac4df2-1383-4bda-bf96-d7c33a9b195a-data-volume\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.595681 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:37.595574 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 18:04:37.595681 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:37.595645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:38.095632847 +0000 UTC m=+59.553449360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : secret "insights-runtime-extractor-tls" not found Jul 09 18:04:37.607338 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.607306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqf6\" (UniqueName: \"kubernetes.io/projected/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-api-access-ptqf6\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:37.797066 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:37.797014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:37.797251 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:37.797170 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:37.797321 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:37.797254 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls podName:f2fbc9b3-0689-47f0-85ae-55ea6a4c1020 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:41.797233672 +0000 UTC m=+63.255050181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bdk7m" (UID: "f2fbc9b3-0689-47f0-85ae-55ea6a4c1020") : secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:38.099688 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:38.099650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:38.099898 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:38.099728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:38.099898 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:38.099837 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 18:04:38.099898 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:38.099857 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 18:04:38.100058 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:38.099924 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:39.099903001 +0000 UTC m=+60.557719527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : configmap "kube-rbac-proxy" not found Jul 09 18:04:38.100058 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:38.099943 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:39.099932579 +0000 UTC m=+60.557749089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : secret "insights-runtime-extractor-tls" not found Jul 09 18:04:38.324977 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:38.324945 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:38.435644 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:38.435567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:38.755226 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:38.755202 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmbxn_745e7b74-43a1-48c1-bb51-2cfce52bbfb5/dns-node-resolver/0.log" Jul 09 18:04:39.106989 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.106884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:39.106989 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.106972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:39.107209 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:39.107055 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 18:04:39.107209 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:39.107072 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 18:04:39.107209 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:39.107127 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:41.107109565 +0000 UTC m=+62.564926080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : configmap "kube-rbac-proxy" not found Jul 09 18:04:39.107209 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:39.107143 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:41.107135135 +0000 UTC m=+62.564951645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : secret "insights-runtime-extractor-tls" not found Jul 09 18:04:39.225196 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.225150 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:39.409852 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.409777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" event={"ID":"605e9e1a-6f24-4886-846b-d3defa7aa69a","Type":"ContainerStarted","Data":"b98cdceaaba044ab3b2c534b6eaf39cb62a3bce43f4a2d13ad14b28c48f2ef2d"} Jul 09 18:04:39.411482 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.411452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" event={"ID":"7e4ee00e-9f1a-4083-95c8-601ce2c001f8","Type":"ContainerStarted","Data":"0c88fc622095709fde56e2fe6c824cb9238671c1479e3239b6b600fbac608a45"} Jul 09 18:04:39.413059 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.413018 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/0.log" Jul 09 18:04:39.413178 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.413082 2564 generic.go:356] "Generic (PLEG): container finished" podID="a53b6e14-0910-41bb-be1f-fa93cf179551" containerID="4f0be2a6594922d8412ee8c1adbf6d96702511b290d34c2e133ae68150c59857" exitCode=255 Jul 09 18:04:39.413178 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.413114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4d5dr" event={"ID":"a53b6e14-0910-41bb-be1f-fa93cf179551","Type":"ContainerDied","Data":"4f0be2a6594922d8412ee8c1adbf6d96702511b290d34c2e133ae68150c59857"} Jul 09 18:04:39.413317 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.413304 2564 scope.go:117] "RemoveContainer" containerID="4f0be2a6594922d8412ee8c1adbf6d96702511b290d34c2e133ae68150c59857" Jul 09 18:04:39.432381 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.432329 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mmn59" podStartSLOduration=1.730581656 podStartE2EDuration="5.432313463s" totalImagesPullingTime="3.701731807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:39.432137171 +0000 UTC m=+60.889953703" watchObservedRunningTime="2026-07-09 18:04:39.432313463 +0000 UTC m=+60.890129985" Jul 09 18:04:39.453952 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:39.453899 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" podStartSLOduration=1.675808773 podStartE2EDuration="5.453879364s" totalImagesPullingTime="3.778070591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:39.452423104 +0000 UTC m=+60.910239636" watchObservedRunningTime="2026-07-09 18:04:39.453879364 +0000 UTC m=+60.911695895" Jul 09 18:04:40.154675 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.154650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmw2x_14256da0-5916-43c0-ad56-8ce687a9191d/node-ca/0.log" Jul 09 18:04:40.207535 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.207498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:40.308570 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.308538 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:40.322749 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.322721 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqvlv" Jul 09 18:04:40.408501 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.408395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:40.417230 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.417203 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/1.log" Jul 09 18:04:40.417631 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.417614 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/0.log" Jul 09 18:04:40.417693 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.417649 2564 generic.go:356] "Generic (PLEG): container finished" podID="a53b6e14-0910-41bb-be1f-fa93cf179551" containerID="fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d" exitCode=255 Jul 09 18:04:40.417762 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.417737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4d5dr" event={"ID":"a53b6e14-0910-41bb-be1f-fa93cf179551","Type":"ContainerDied","Data":"fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d"} Jul 09 18:04:40.417837 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.417824 2564 scope.go:117] "RemoveContainer" containerID="4f0be2a6594922d8412ee8c1adbf6d96702511b290d34c2e133ae68150c59857" Jul 09 18:04:40.418065 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.418044 2564 scope.go:117] "RemoveContainer" containerID="fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d" Jul 09 18:04:40.418344 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:40.418322 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4d5dr_openshift-console-operator(a53b6e14-0910-41bb-be1f-fa93cf179551)\"" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podUID="a53b6e14-0910-41bb-be1f-fa93cf179551" Jul 09 18:04:40.542981 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.542948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:40.700085 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.700050 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:40.769170 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.769133 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqzxk_f048dafc-a792-420c-bf53-c158974e1ca9/serve-healthcheck-canary/0.log" Jul 09 18:04:40.798041 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.797996 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6"] Jul 09 18:04:40.813198 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.813170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" Jul 09 18:04:40.816498 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.816469 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 18:04:40.816668 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.816539 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 18:04:40.816668 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.816591 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pvjwd\"" Jul 09 18:04:40.820164 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.820141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdcr\" (UniqueName: \"kubernetes.io/projected/08755ce9-363a-4ed0-b123-faded1854a48-kube-api-access-gfdcr\") pod \"migrator-7f59b54f6c-j4wk6\" (UID: \"08755ce9-363a-4ed0-b123-faded1854a48\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" Jul 09 18:04:40.826100 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.826075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6"] Jul 09 18:04:40.920945 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.920907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdcr\" (UniqueName: \"kubernetes.io/projected/08755ce9-363a-4ed0-b123-faded1854a48-kube-api-access-gfdcr\") pod \"migrator-7f59b54f6c-j4wk6\" (UID: \"08755ce9-363a-4ed0-b123-faded1854a48\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" Jul 09 18:04:40.939600 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.939572 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdcr\" (UniqueName: \"kubernetes.io/projected/08755ce9-363a-4ed0-b123-faded1854a48-kube-api-access-gfdcr\") pod \"migrator-7f59b54f6c-j4wk6\" (UID: \"08755ce9-363a-4ed0-b123-faded1854a48\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" Jul 09 18:04:40.994765 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:40.994674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:41.122574 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.122534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" Jul 09 18:04:41.122789 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.122768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:41.122875 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.122839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:41.122930 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.122909 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 18:04:41.122979 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.122925 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 18:04:41.123015 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.122990 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:45.122975777 +0000 UTC m=+66.580792310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : secret "insights-runtime-extractor-tls" not found Jul 09 18:04:41.123015 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.123010 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:45.122997952 +0000 UTC m=+66.580814463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : configmap "kube-rbac-proxy" not found Jul 09 18:04:41.187200 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.187171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:41.300934 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.300838 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6"] Jul 09 18:04:41.305596 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:41.305558 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08755ce9_363a_4ed0_b123_faded1854a48.slice/crio-5669a48d2f1fb87eb66da257e75404ef373a90c477c46a1c723f1b1f2d1d557f WatchSource:0}: Error finding container 5669a48d2f1fb87eb66da257e75404ef373a90c477c46a1c723f1b1f2d1d557f: Status 404 returned error can't find the container with id 5669a48d2f1fb87eb66da257e75404ef373a90c477c46a1c723f1b1f2d1d557f Jul 09 18:04:41.422695 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.422654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" event={"ID":"08755ce9-363a-4ed0-b123-faded1854a48","Type":"ContainerStarted","Data":"5669a48d2f1fb87eb66da257e75404ef373a90c477c46a1c723f1b1f2d1d557f"} Jul 09 18:04:41.424157 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.424133 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/1.log" Jul 09 18:04:41.424472 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.424457 2564 scope.go:117] "RemoveContainer" containerID="fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d" Jul 09 18:04:41.424647 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.424626 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4d5dr_openshift-console-operator(a53b6e14-0910-41bb-be1f-fa93cf179551)\"" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podUID="a53b6e14-0910-41bb-be1f-fa93cf179551" Jul 09 18:04:41.828595 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:41.828552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:41.829018 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.828700 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:41.829018 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:41.828767 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls podName:f2fbc9b3-0689-47f0-85ae-55ea6a4c1020 nodeName:}" failed. No retries permitted until 2026-07-09 18:04:49.828751402 +0000 UTC m=+71.286567911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bdk7m" (UID: "f2fbc9b3-0689-47f0-85ae-55ea6a4c1020") : secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:42.746940 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:42.746905 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:42.959070 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:42.959011 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:43.432432 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:43.432393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" event={"ID":"08755ce9-363a-4ed0-b123-faded1854a48","Type":"ContainerStarted","Data":"acb58b9fe72f2de000f9dfd96c9dd26612b4f1c6625927e61286e5fbbda76c8f"} Jul 09 18:04:43.432607 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:43.432478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" event={"ID":"08755ce9-363a-4ed0-b123-faded1854a48","Type":"ContainerStarted","Data":"00d9f5ce9d40ac22dba49c7047d6ab42ffcf33f7448bde5a0032bfd9c893fd43"} Jul 09 18:04:43.454243 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:43.454181 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-j4wk6" podStartSLOduration=2.164903063 podStartE2EDuration="3.45416371s" totalImagesPullingTime="1.289260647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:43.453581294 +0000 UTC m=+64.911397826" watchObservedRunningTime="2026-07-09 18:04:43.45416371 +0000 UTC m=+64.911980241" Jul 09 18:04:43.635222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:43.635182 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:43.743327 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:43.743245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:44.252171 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.252130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:44.462153 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.462113 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:44.462153 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.462159 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:04:44.462479 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.462467 2564 scope.go:117] "RemoveContainer" containerID="fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d" Jul 09 18:04:44.462619 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:44.462601 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4d5dr_openshift-console-operator(a53b6e14-0910-41bb-be1f-fa93cf179551)\"" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podUID="a53b6e14-0910-41bb-be1f-fa93cf179551" Jul 09 18:04:44.755170 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.755124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:04:44.755385 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.755242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:44.758150 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.758130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 18:04:44.758216 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.758199 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 18:04:44.765890 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:44.765857 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 18:04:44.766003 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:44.765945 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs podName:b1ee9cce-c279-478f-8ca0-dd6bae1ad007 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:48.765923584 +0000 UTC m=+130.223740108 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs") pod "network-metrics-daemon-vgxd7" (UID: "b1ee9cce-c279-478f-8ca0-dd6bae1ad007") : secret "metrics-daemon-secret" not found Jul 09 18:04:44.768228 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.768207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa-original-pull-secret\") pod \"global-pull-secret-syncer-cg4q9\" (UID: \"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa\") " pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:44.777368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.777328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cg4q9" Jul 09 18:04:44.855803 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.855769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:44.858744 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.858714 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88lgh\" (UniqueName: \"kubernetes.io/projected/ba307fab-e4c6-4429-a6e0-feb3f2b474e2-kube-api-access-88lgh\") pod \"network-check-target-kjwj7\" (UID: \"ba307fab-e4c6-4429-a6e0-feb3f2b474e2\") " pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:44.922133 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:44.921941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cg4q9"] Jul 09 18:04:44.925179 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:44.925151 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd09c09_cbca_4c33_a7ec_4d513d1c5cfa.slice/crio-e9b505fff05d66c7b2e9ca91e8406913de131868be29dceae5aba357b49c03be WatchSource:0}: Error finding container e9b505fff05d66c7b2e9ca91e8406913de131868be29dceae5aba357b49c03be: Status 404 returned error can't find the container with id e9b505fff05d66c7b2e9ca91e8406913de131868be29dceae5aba357b49c03be Jul 09 18:04:45.072287 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.072195 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdjws\"" Jul 09 18:04:45.080519 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.080490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:45.131280 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.131198 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:45.158168 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.158131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:45.158324 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.158187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:45.158324 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:45.158295 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 18:04:45.158324 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:45.158309 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 18:04:45.158427 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:45.158350 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:53.158335736 +0000 UTC m=+74.616152247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : configmap "kube-rbac-proxy" not found Jul 09 18:04:45.158427 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:45.158387 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:04:53.158367531 +0000 UTC m=+74.616184049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : secret "insights-runtime-extractor-tls" not found Jul 09 18:04:45.229297 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.229261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kjwj7"] Jul 09 18:04:45.232812 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:04:45.232789 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba307fab_e4c6_4429_a6e0_feb3f2b474e2.slice/crio-91803b7687d4c7ada0f5c20b5a4ad841bf76e5ac37d4f9b989a0c422b9d2e383 WatchSource:0}: Error finding container 91803b7687d4c7ada0f5c20b5a4ad841bf76e5ac37d4f9b989a0c422b9d2e383: Status 404 returned error can't find the container with id 91803b7687d4c7ada0f5c20b5a4ad841bf76e5ac37d4f9b989a0c422b9d2e383 Jul 09 18:04:45.337284 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.337185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:45.439225 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.439189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kjwj7" event={"ID":"ba307fab-e4c6-4429-a6e0-feb3f2b474e2","Type":"ContainerStarted","Data":"876a1aebc0e42b0cec0111b261d15c28b992749ba2fd1400f57f4f6411ff06a9"} Jul 09 18:04:45.439437 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.439243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kjwj7" event={"ID":"ba307fab-e4c6-4429-a6e0-feb3f2b474e2","Type":"ContainerStarted","Data":"91803b7687d4c7ada0f5c20b5a4ad841bf76e5ac37d4f9b989a0c422b9d2e383"} Jul 09 18:04:45.439437 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.439295 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:04:45.440407 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.440373 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cg4q9" event={"ID":"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa","Type":"ContainerStarted","Data":"e9b505fff05d66c7b2e9ca91e8406913de131868be29dceae5aba357b49c03be"} Jul 09 18:04:45.472695 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.472643 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kjwj7" podStartSLOduration=66.472624843 podStartE2EDuration="1m6.472624843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:45.464697832 +0000 UTC m=+66.922514364" watchObservedRunningTime="2026-07-09 18:04:45.472624843 +0000 UTC m=+66.930441375" Jul 09 18:04:45.540242 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.540212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:45.659085 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.658965 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:45.809888 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:45.809846 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:46.268285 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:46.268241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:04:46.268489 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:46.268301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:04:46.268489 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:46.268397 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:04:46.268489 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:46.268415 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:04:46.268489 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:46.268420 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58fbbddf8d-qcbgd: secret "image-registry-tls" not found Jul 09 18:04:46.268489 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:46.268479 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls podName:a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f nodeName:}" failed. No retries permitted until 2026-07-09 18:05:18.268462419 +0000 UTC m=+99.726278932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls") pod "dns-default-phqc7" (UID: "a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f") : secret "dns-default-metrics-tls" not found Jul 09 18:04:46.268747 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:46.268497 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls podName:4f91815e-16fc-46c5-803c-69d17edf90c9 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:18.268488593 +0000 UTC m=+99.726305106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls") pod "image-registry-58fbbddf8d-qcbgd" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9") : secret "image-registry-tls" not found Jul 09 18:04:47.032473 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:47.032438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:47.275083 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:47.275022 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:47.424375 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:47.424343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:47.608653 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:47.608610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:47.808605 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:47.808501 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:47.926749 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:47.926711 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:48.027864 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:48.027825 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:49.242662 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:49.242621 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:49.318080 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:49.318045 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:49.427167 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:49.427130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:49.897013 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:49.896982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:04:49.897281 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:49.897135 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:49.897281 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:49.897204 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls podName:f2fbc9b3-0689-47f0-85ae-55ea6a4c1020 nodeName:}" failed. No retries permitted until 2026-07-09 18:05:05.897189364 +0000 UTC m=+87.355005874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bdk7m" (UID: "f2fbc9b3-0689-47f0-85ae-55ea6a4c1020") : secret "cluster-monitoring-operator-tls" not found Jul 09 18:04:50.116967 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:50.116864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:50.217166 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:50.217126 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:50.280615 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:50.280576 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:50.459738 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:50.459700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cg4q9" event={"ID":"dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa","Type":"ContainerStarted","Data":"cb9159d01a73d1729444f8fe8f9c977790b58d93b9747c630d90112a6172a4d5"} Jul 09 18:04:50.477161 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:50.477104 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cg4q9" podStartSLOduration=65.586289199 podStartE2EDuration="1m10.477086018s" totalImagesPullingTime="4.890796819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:50.475964833 +0000 UTC m=+71.933781364" watchObservedRunningTime="2026-07-09 18:04:50.477086018 +0000 UTC m=+71.934902596" Jul 09 18:04:50.533957 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:50.533916 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:51.256474 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:51.256442 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:51.394622 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:51.394590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:51.603471 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:51.603386 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:51.792994 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:51.792947 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:51.991223 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:51.991180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:52.197594 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:52.197556 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:53.224155 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.224110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:53.224155 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.224161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:53.224569 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:53.224282 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 18:04:53.224569 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:04:53.224371 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls podName:58ac4df2-1383-4bda-bf96-d7c33a9b195a nodeName:}" failed. No retries permitted until 2026-07-09 18:05:09.22435196 +0000 UTC m=+90.682168473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjwm6" (UID: "58ac4df2-1383-4bda-bf96-d7c33a9b195a") : secret "insights-runtime-extractor-tls" not found Jul 09 18:04:53.224658 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.224641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58ac4df2-1383-4bda-bf96-d7c33a9b195a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:04:53.404086 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.404055 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:53.505535 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.505446 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:53.657273 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.657227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:53.904926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:53.904836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:54.028882 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:54.028844 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:54.272847 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:54.272813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:55.209350 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:55.209317 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:55.423164 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:55.423134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:55.601438 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:55.601340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:55.744349 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:55.744313 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:04:55.824335 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:04:55.824299 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:00.057326 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.057216 2564 scope.go:117] "RemoveContainer" containerID="fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d" Jul 09 18:05:00.492825 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.492799 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:05:00.493213 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.493196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/1.log" Jul 09 18:05:00.493275 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.493234 2564 generic.go:356] "Generic (PLEG): container finished" podID="a53b6e14-0910-41bb-be1f-fa93cf179551" containerID="a2ed7a72290b508c8b267e5d9d1a79906452cd9d635e250548c879c55f4915fd" exitCode=255 Jul 09 18:05:00.493275 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.493261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4d5dr" event={"ID":"a53b6e14-0910-41bb-be1f-fa93cf179551","Type":"ContainerDied","Data":"a2ed7a72290b508c8b267e5d9d1a79906452cd9d635e250548c879c55f4915fd"} Jul 09 18:05:00.493390 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.493301 2564 scope.go:117] "RemoveContainer" containerID="fbe0a2b61bdc99d774602e7ce0cee1f25cda6dcf34c5301c79c63994ebbd9d4d" Jul 09 18:05:00.493651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:00.493629 2564 scope.go:117] "RemoveContainer" containerID="a2ed7a72290b508c8b267e5d9d1a79906452cd9d635e250548c879c55f4915fd" Jul 09 18:05:00.493859 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:05:00.493831 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-4d5dr_openshift-console-operator(a53b6e14-0910-41bb-be1f-fa93cf179551)\"" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podUID="a53b6e14-0910-41bb-be1f-fa93cf179551" Jul 09 18:05:01.497942 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:01.497900 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:05:04.461827 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:04.461789 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:05:04.462241 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:04.461849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:05:04.462241 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:04.462168 2564 scope.go:117] "RemoveContainer" containerID="a2ed7a72290b508c8b267e5d9d1a79906452cd9d635e250548c879c55f4915fd" Jul 09 18:05:04.462325 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:05:04.462305 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-4d5dr_openshift-console-operator(a53b6e14-0910-41bb-be1f-fa93cf179551)\"" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podUID="a53b6e14-0910-41bb-be1f-fa93cf179551" Jul 09 18:05:05.923605 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:05.923547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:05:05.926044 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:05.926010 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2fbc9b3-0689-47f0-85ae-55ea6a4c1020-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bdk7m\" (UID: \"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:05:06.155436 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.155403 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hk88r\"" Jul 09 18:05:06.162163 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.162133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" Jul 09 18:05:06.295833 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.295720 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m"] Jul 09 18:05:06.298607 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:06.298580 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fbc9b3_0689_47f0_85ae_55ea6a4c1020.slice/crio-08020bae947df44ca52705d1f9a73614abd3cf6c0e6b071ee87a0de6eceaf108 WatchSource:0}: Error finding container 08020bae947df44ca52705d1f9a73614abd3cf6c0e6b071ee87a0de6eceaf108: Status 404 returned error can't find the container with id 08020bae947df44ca52705d1f9a73614abd3cf6c0e6b071ee87a0de6eceaf108 Jul 09 18:05:06.512975 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.512889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" event={"ID":"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020","Type":"ContainerStarted","Data":"08020bae947df44ca52705d1f9a73614abd3cf6c0e6b071ee87a0de6eceaf108"} Jul 09 18:05:06.671640 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.671603 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8"] Jul 09 18:05:06.673939 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.673921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.680600 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.680576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 18:05:06.680695 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.680577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9cp4z\"" Jul 09 18:05:06.680695 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.680639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 18:05:06.681330 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.681315 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 18:05:06.682204 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.682184 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 18:05:06.716851 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.716818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8"] Jul 09 18:05:06.740640 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.739403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a55a13d-7435-4230-8fdc-5b123c7be073-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd87ddb86-nrcx8\" (UID: \"5a55a13d-7435-4230-8fdc-5b123c7be073\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.740640 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.739488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9h2r\" (UniqueName: \"kubernetes.io/projected/5a55a13d-7435-4230-8fdc-5b123c7be073-kube-api-access-b9h2r\") pod \"managed-serviceaccount-addon-agent-bd87ddb86-nrcx8\" (UID: \"5a55a13d-7435-4230-8fdc-5b123c7be073\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.840945 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.840846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a55a13d-7435-4230-8fdc-5b123c7be073-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd87ddb86-nrcx8\" (UID: \"5a55a13d-7435-4230-8fdc-5b123c7be073\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.840945 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.840901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9h2r\" (UniqueName: \"kubernetes.io/projected/5a55a13d-7435-4230-8fdc-5b123c7be073-kube-api-access-b9h2r\") pod \"managed-serviceaccount-addon-agent-bd87ddb86-nrcx8\" (UID: \"5a55a13d-7435-4230-8fdc-5b123c7be073\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.843567 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.843539 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a55a13d-7435-4230-8fdc-5b123c7be073-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd87ddb86-nrcx8\" (UID: \"5a55a13d-7435-4230-8fdc-5b123c7be073\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.872972 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.872938 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9h2r\" (UniqueName: \"kubernetes.io/projected/5a55a13d-7435-4230-8fdc-5b123c7be073-kube-api-access-b9h2r\") pod \"managed-serviceaccount-addon-agent-bd87ddb86-nrcx8\" (UID: \"5a55a13d-7435-4230-8fdc-5b123c7be073\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:06.946547 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.946509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:06.994655 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:06.994610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" Jul 09 18:05:07.127847 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.127760 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:07.166708 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.166673 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8"] Jul 09 18:05:07.169849 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:07.169816 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a55a13d_7435_4230_8fdc_5b123c7be073.slice/crio-6c4169fad04be665994086ab27aad763d997defdab7d988c7c76a5f97876511a WatchSource:0}: Error finding container 6c4169fad04be665994086ab27aad763d997defdab7d988c7c76a5f97876511a: Status 404 returned error can't find the container with id 6c4169fad04be665994086ab27aad763d997defdab7d988c7c76a5f97876511a Jul 09 18:05:07.341846 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.341811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:07.517552 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.517516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" event={"ID":"5a55a13d-7435-4230-8fdc-5b123c7be073","Type":"ContainerStarted","Data":"6c4169fad04be665994086ab27aad763d997defdab7d988c7c76a5f97876511a"} Jul 09 18:05:07.522330 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.522293 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:07.695233 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.695200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:07.792190 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:07.792101 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:08.980107 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:08.979982 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:09.128708 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.128671 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:09.261498 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.261406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:05:09.263938 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.263906 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58ac4df2-1383-4bda-bf96-d7c33a9b195a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjwm6\" (UID: \"58ac4df2-1383-4bda-bf96-d7c33a9b195a\") " pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:05:09.398291 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.398240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:09.530148 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.530049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sqrc5\"" Jul 09 18:05:09.532514 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.532485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjwm6" Jul 09 18:05:09.533961 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.533928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" event={"ID":"f2fbc9b3-0689-47f0-85ae-55ea6a4c1020","Type":"ContainerStarted","Data":"b7b57af2a36841db44170d2ac66419b3ec2b2e3c55d62d83d61010ffb08f64e1"} Jul 09 18:05:09.607151 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.607067 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bdk7m" podStartSLOduration=33.422920169 podStartE2EDuration="35.607045231s" totalImagesPullingTime="2.184125062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:09.606645381 +0000 UTC m=+91.064461913" watchObservedRunningTime="2026-07-09 18:05:09.607045231 +0000 UTC m=+91.064861762" Jul 09 18:05:09.671758 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.671716 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:09.739932 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:09.739895 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjwm6"] Jul 09 18:05:09.742887 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:09.742858 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ac4df2_1383_4bda_bf96_d7c33a9b195a.slice/crio-7d54877fde7dd22645853f2286185afc4ae9e7fc473a70af561aae1c9b47061a WatchSource:0}: Error finding container 7d54877fde7dd22645853f2286185afc4ae9e7fc473a70af561aae1c9b47061a: Status 404 returned error can't find the container with id 7d54877fde7dd22645853f2286185afc4ae9e7fc473a70af561aae1c9b47061a Jul 09 18:05:10.541271 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:10.541233 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" event={"ID":"5a55a13d-7435-4230-8fdc-5b123c7be073","Type":"ContainerStarted","Data":"0f01d694b091f72844ce278fb78f1c33414c533754ff4204552ac71b25311f7c"} Jul 09 18:05:10.543321 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:10.543286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjwm6" event={"ID":"58ac4df2-1383-4bda-bf96-d7c33a9b195a","Type":"ContainerStarted","Data":"7d54877fde7dd22645853f2286185afc4ae9e7fc473a70af561aae1c9b47061a"} Jul 09 18:05:10.570340 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:10.570174 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd87ddb86-nrcx8" podStartSLOduration=2.109246519 podStartE2EDuration="4.570150768s" totalImagesPullingTime="2.460904249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:10.568621062 +0000 UTC m=+92.026437607" watchObservedRunningTime="2026-07-09 18:05:10.570150768 +0000 UTC m=+92.027967302" Jul 09 18:05:13.095082 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:13.095020 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:13.184952 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:13.184917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:14.559346 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:14.559250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjwm6" event={"ID":"58ac4df2-1383-4bda-bf96-d7c33a9b195a","Type":"ContainerStarted","Data":"b184a7f97bfd09b0b655d4774311a7a20dacdbf26fb46794e8522f007e739c64"} Jul 09 18:05:15.340145 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:15.340102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:15.537903 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:15.537848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:15.564746 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:15.564705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjwm6" event={"ID":"58ac4df2-1383-4bda-bf96-d7c33a9b195a","Type":"ContainerStarted","Data":"032dd406fffa28f214ccf190fa3859c9affd4aff4f0fdb55f7288b569c8004f0"} Jul 09 18:05:15.876208 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:15.876169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:16.448590 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:16.448563 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kjwj7" Jul 09 18:05:17.573934 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:17.573843 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjwm6" event={"ID":"58ac4df2-1383-4bda-bf96-d7c33a9b195a","Type":"ContainerStarted","Data":"386fac801d36fb1c901b242c52afda9c6261078b555fee9a34d967412c2686d7"} Jul 09 18:05:17.670337 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:17.670303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:17.789089 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:17.789055 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:18.036417 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.036383 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:18.342114 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.342003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:18.342114 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.342083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:05:18.344442 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.344411 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f-metrics-tls\") pod \"dns-default-phqc7\" (UID: \"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f\") " pod="openshift-dns/dns-default-phqc7" Jul 09 18:05:18.344556 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.344503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"image-registry-58fbbddf8d-qcbgd\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:18.586923 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.586895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vsp6r\"" Jul 09 18:05:18.594661 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.594641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:18.610929 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.610907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h78nz\"" Jul 09 18:05:18.616252 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.616219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:18.619040 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.618997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phqc7" Jul 09 18:05:18.737117 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.737067 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hjwm6" podStartSLOduration=34.387154514 podStartE2EDuration="41.737046361s" totalImagesPullingTime="7.349891847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:04:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:17.686467907 +0000 UTC m=+99.144284449" watchObservedRunningTime="2026-07-09 18:05:18.737046361 +0000 UTC m=+100.194862886" Jul 09 18:05:18.737383 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.737370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58fbbddf8d-qcbgd"] Jul 09 18:05:18.740229 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:18.740203 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f91815e_16fc_46c5_803c_69d17edf90c9.slice/crio-37a51475f0d07fd0e696f56d86d31c600949308d6fa67bfde3d8a39bc8684770 WatchSource:0}: Error finding container 37a51475f0d07fd0e696f56d86d31c600949308d6fa67bfde3d8a39bc8684770: Status 404 returned error can't find the container with id 37a51475f0d07fd0e696f56d86d31c600949308d6fa67bfde3d8a39bc8684770 Jul 09 18:05:18.755429 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:18.755410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phqc7"] Jul 09 18:05:18.758143 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:18.758120 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d7771f_2471_4b2c_9a92_2dd9f6bd7c5f.slice/crio-9ac7300b0876077553ee38355c81deeec98bdfb34ae05385b0f527b43c67431c WatchSource:0}: Error finding container 9ac7300b0876077553ee38355c81deeec98bdfb34ae05385b0f527b43c67431c: Status 404 returned error can't find the container with id 9ac7300b0876077553ee38355c81deeec98bdfb34ae05385b0f527b43c67431c Jul 09 18:05:19.058244 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:19.058215 2564 scope.go:117] "RemoveContainer" containerID="a2ed7a72290b508c8b267e5d9d1a79906452cd9d635e250548c879c55f4915fd" Jul 09 18:05:19.058409 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:05:19.058362 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-4d5dr_openshift-console-operator(a53b6e14-0910-41bb-be1f-fa93cf179551)\"" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podUID="a53b6e14-0910-41bb-be1f-fa93cf179551" Jul 09 18:05:19.582347 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:19.582309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phqc7" event={"ID":"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f","Type":"ContainerStarted","Data":"9ac7300b0876077553ee38355c81deeec98bdfb34ae05385b0f527b43c67431c"} Jul 09 18:05:19.584001 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:19.583971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" event={"ID":"4f91815e-16fc-46c5-803c-69d17edf90c9","Type":"ContainerStarted","Data":"9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac"} Jul 09 18:05:19.584159 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:19.584015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" event={"ID":"4f91815e-16fc-46c5-803c-69d17edf90c9","Type":"ContainerStarted","Data":"37a51475f0d07fd0e696f56d86d31c600949308d6fa67bfde3d8a39bc8684770"} Jul 09 18:05:19.584159 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:19.584076 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:19.609153 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:19.609092 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" podStartSLOduration=99.60907325 podStartE2EDuration="1m39.60907325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:19.608229544 +0000 UTC m=+101.066046075" watchObservedRunningTime="2026-07-09 18:05:19.60907325 +0000 UTC m=+101.066889762" Jul 09 18:05:20.546875 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.546843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:20.641241 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.641194 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:20.798321 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.798258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:20.978243 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.978216 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x4vbl"] Jul 09 18:05:20.980790 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.980769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:20.986951 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.986911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 18:05:20.987317 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.987273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 18:05:20.987654 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.987639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sdp9m\"" Jul 09 18:05:20.987897 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.987878 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 18:05:20.988009 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:20.987989 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 18:05:21.021380 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.021336 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:21.130966 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.130873 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:21.167701 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-sys\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.167701 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-textfile\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.167902 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-wtmp\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.167902 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.167902 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-947rw\" (UniqueName: \"kubernetes.io/projected/e2584366-0f49-400c-b577-c82bd8d3794b-kube-api-access-947rw\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.167902 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2584366-0f49-400c-b577-c82bd8d3794b-metrics-client-ca\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.168053 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-root\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.168053 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-tls\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.168053 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.167984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.260706 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.260673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:21.268686 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2584366-0f49-400c-b577-c82bd8d3794b-metrics-client-ca\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268808 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-root\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268808 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-tls\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268808 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268808 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268779 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-root\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-sys\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-sys\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-textfile\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-wtmp\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.268974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.268930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-947rw\" (UniqueName: \"kubernetes.io/projected/e2584366-0f49-400c-b577-c82bd8d3794b-kube-api-access-947rw\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.269276 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.269080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-wtmp\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.269276 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.269186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-textfile\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.269408 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.269384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.269476 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.269436 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2584366-0f49-400c-b577-c82bd8d3794b-metrics-client-ca\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.271722 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.271690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-tls\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.271836 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.271805 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2584366-0f49-400c-b577-c82bd8d3794b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.290303 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.290271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-947rw\" (UniqueName: \"kubernetes.io/projected/e2584366-0f49-400c-b577-c82bd8d3794b-kube-api-access-947rw\") pod \"node-exporter-x4vbl\" (UID: \"e2584366-0f49-400c-b577-c82bd8d3794b\") " pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.290470 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.290424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4vbl" Jul 09 18:05:21.300767 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:21.300739 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2584366_0f49_400c_b577_c82bd8d3794b.slice/crio-a47eb23133f7f5071512510041e8bea3d836becac73558725056b7af2d37aebe WatchSource:0}: Error finding container a47eb23133f7f5071512510041e8bea3d836becac73558725056b7af2d37aebe: Status 404 returned error can't find the container with id a47eb23133f7f5071512510041e8bea3d836becac73558725056b7af2d37aebe Jul 09 18:05:21.439961 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.439925 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:21.591358 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.591323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phqc7" event={"ID":"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f","Type":"ContainerStarted","Data":"b8ac59fcdb9fe76b27f257c980ba7b78298fa48a5f2dfd9c614e27e1b76de960"} Jul 09 18:05:21.591541 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.591409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phqc7" event={"ID":"a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f","Type":"ContainerStarted","Data":"d905acc3f47b1a3007386ca2e0e340115d88158cdbfbf756c587d4343e3b10cd"} Jul 09 18:05:21.591541 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.591439 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-phqc7" Jul 09 18:05:21.592548 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.592525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4vbl" event={"ID":"e2584366-0f49-400c-b577-c82bd8d3794b","Type":"ContainerStarted","Data":"a47eb23133f7f5071512510041e8bea3d836becac73558725056b7af2d37aebe"} Jul 09 18:05:21.622843 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.622796 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-phqc7" podStartSLOduration=65.672415089 podStartE2EDuration="1m7.622780908s" totalImagesPullingTime="1.950365819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:21.621850644 +0000 UTC m=+103.079667179" watchObservedRunningTime="2026-07-09 18:05:21.622780908 +0000 UTC m=+103.080597501" Jul 09 18:05:21.727980 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:21.727900 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:22.048564 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:22.048479 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:22.183331 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:22.183295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:22.493333 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:22.493301 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:22.597638 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:22.597549 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2584366-0f49-400c-b577-c82bd8d3794b" containerID="5f02540263f91bb2858187b876e11e41990551f33a1001540b37cbf6a4b0fe85" exitCode=0 Jul 09 18:05:22.597782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:22.597642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4vbl" event={"ID":"e2584366-0f49-400c-b577-c82bd8d3794b","Type":"ContainerDied","Data":"5f02540263f91bb2858187b876e11e41990551f33a1001540b37cbf6a4b0fe85"} Jul 09 18:05:22.621171 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:22.621140 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:23.448039 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:23.448005 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:23.545942 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:23.545909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:23.603194 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:23.603166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4vbl" event={"ID":"e2584366-0f49-400c-b577-c82bd8d3794b","Type":"ContainerStarted","Data":"dfe78e697874437d398c1dbd1f7ad0d585c928838e9cf701ebf892afc3847f23"} Jul 09 18:05:23.603363 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:23.603216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4vbl" event={"ID":"e2584366-0f49-400c-b577-c82bd8d3794b","Type":"ContainerStarted","Data":"fbb3c46c6f4812c73d9d691a5e15814c2763cdbedaa7c4736a90b783e11206c9"} Jul 09 18:05:23.630262 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:23.630209 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x4vbl" podStartSLOduration=2.621094169 podStartE2EDuration="3.630192525s" totalImagesPullingTime="937.137892ms" totalInitContainerRuntime="71.960464ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:23.628981407 +0000 UTC m=+105.086797950" watchObservedRunningTime="2026-07-09 18:05:23.630192525 +0000 UTC m=+105.088009089" Jul 09 18:05:24.009335 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:24.009294 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:24.198971 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:24.198936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:24.744558 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:24.744520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:24.876483 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:24.876447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:25.581871 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:25.581832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:25.843162 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:25.843065 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:26.697810 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:26.697766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:26.774501 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:26.774464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:27.653988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:27.653947 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:28.926704 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:28.926666 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58fbbddf8d-qcbgd"] Jul 09 18:05:29.030708 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:29.030673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:29.103256 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:29.103227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:29.218462 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:29.218364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:29.301575 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:29.301540 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:30.973185 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:30.973144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:31.056678 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.056640 2564 scope.go:117] "RemoveContainer" containerID="a2ed7a72290b508c8b267e5d9d1a79906452cd9d635e250548c879c55f4915fd" Jul 09 18:05:31.095777 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.095743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:31.198841 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.198805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:31.600353 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.600326 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-phqc7" Jul 09 18:05:31.633929 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.633891 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:05:31.634109 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.633959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4d5dr" event={"ID":"a53b6e14-0910-41bb-be1f-fa93cf179551","Type":"ContainerStarted","Data":"e73710874c23afc59f4b97beb58c1c866d731ea038838c50c6fad785b7d28b51"} Jul 09 18:05:31.634318 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.634298 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:05:31.653702 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.653651 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-4d5dr" podStartSLOduration=53.908354575 podStartE2EDuration="57.653634557s" totalImagesPullingTime="3.745279982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:31.651856406 +0000 UTC m=+113.109672940" watchObservedRunningTime="2026-07-09 18:05:31.653634557 +0000 UTC m=+113.111451090" Jul 09 18:05:31.939772 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:31.939740 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-4d5dr" Jul 09 18:05:32.202042 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.201942 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-dbh4x"] Jul 09 18:05:32.205153 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.205137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:32.213734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.213717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xrfqp\"" Jul 09 18:05:32.214294 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.214279 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 18:05:32.214553 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.214538 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 18:05:32.225121 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.225102 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dbh4x"] Jul 09 18:05:32.252427 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.252398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkm5p\" (UniqueName: \"kubernetes.io/projected/22b2465d-c63c-49aa-93bb-5dd1cc5c2704-kube-api-access-dkm5p\") pod \"downloads-68c9cbb497-dbh4x\" (UID: \"22b2465d-c63c-49aa-93bb-5dd1cc5c2704\") " pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:32.257238 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.257212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:32.327232 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.327176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:32.353338 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.353300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkm5p\" (UniqueName: \"kubernetes.io/projected/22b2465d-c63c-49aa-93bb-5dd1cc5c2704-kube-api-access-dkm5p\") pod \"downloads-68c9cbb497-dbh4x\" (UID: \"22b2465d-c63c-49aa-93bb-5dd1cc5c2704\") " pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:32.363553 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.363521 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkm5p\" (UniqueName: \"kubernetes.io/projected/22b2465d-c63c-49aa-93bb-5dd1cc5c2704-kube-api-access-dkm5p\") pod \"downloads-68c9cbb497-dbh4x\" (UID: \"22b2465d-c63c-49aa-93bb-5dd1cc5c2704\") " pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:32.450999 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.450954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:32.513835 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.513741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:32.653692 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.653662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dbh4x"] Jul 09 18:05:32.657176 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:32.657149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b2465d_c63c_49aa_93bb_5dd1cc5c2704.slice/crio-50d7340cd7acea95b08d68833204b283b5b77b66d3314b9f6fc890282c433bc2 WatchSource:0}: Error finding container 50d7340cd7acea95b08d68833204b283b5b77b66d3314b9f6fc890282c433bc2: Status 404 returned error can't find the container with id 50d7340cd7acea95b08d68833204b283b5b77b66d3314b9f6fc890282c433bc2 Jul 09 18:05:32.818458 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.818364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:32.921532 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:32.921503 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:33.219048 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:33.218996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:33.320212 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:33.320164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:33.472510 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:33.472412 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:33.593231 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:33.593192 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:33.643555 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:33.643523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dbh4x" event={"ID":"22b2465d-c63c-49aa-93bb-5dd1cc5c2704","Type":"ContainerStarted","Data":"50d7340cd7acea95b08d68833204b283b5b77b66d3314b9f6fc890282c433bc2"} Jul 09 18:05:33.818472 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:33.818388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:34.015130 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:34.015092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:34.334779 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:34.334731 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:35.034248 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:35.034202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:35.096412 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:35.096371 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:37.174740 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:37.174700 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:37.273326 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:37.273292 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:38.422103 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:38.422068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:38.522938 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:38.522907 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:38.934147 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:38.934105 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:42.478639 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.478587 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f6996c57-zlrqq"] Jul 09 18:05:42.479452 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.479424 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:42.522750 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.522714 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f6996c57-zlrqq"] Jul 09 18:05:42.522934 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.522836 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.525563 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.525540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 18:05:42.526371 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.526347 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 18:05:42.526497 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.526400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gzclh\"" Jul 09 18:05:42.526497 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.526429 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 18:05:42.526497 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.526459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 18:05:42.526718 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.526572 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 18:05:42.561178 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.561146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:42.644627 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.644592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-service-ca\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.644821 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.644657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-oauth-serving-cert\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.644821 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.644685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-config\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.644821 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.644720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-serving-cert\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.644821 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.644752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-oauth-config\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.645022 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.644806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mjzl\" (UniqueName: \"kubernetes.io/projected/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-kube-api-access-5mjzl\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.684205 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.684160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:42.745757 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.745662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-config\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.745757 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.745727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-serving-cert\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.745981 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.745761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-oauth-config\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.745981 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.745779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mjzl\" (UniqueName: \"kubernetes.io/projected/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-kube-api-access-5mjzl\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.745981 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.745844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-service-ca\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.745981 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.745911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-oauth-serving-cert\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.746613 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.746564 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-config\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.746749 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.746621 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-service-ca\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.746749 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.746710 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-oauth-serving-cert\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.749382 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.749359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-oauth-config\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.749504 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.749466 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-serving-cert\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.756723 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.756699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mjzl\" (UniqueName: \"kubernetes.io/projected/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-kube-api-access-5mjzl\") pod \"console-67f6996c57-zlrqq\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:42.833595 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:42.833557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:05:43.640475 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:43.640432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:45.236335 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:45.236285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:45.307273 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:45.307231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:48.673918 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:48.673878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:48.797546 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:48.797508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:05:48.800547 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:48.800520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1ee9cce-c279-478f-8ca0-dd6bae1ad007-metrics-certs\") pod \"network-metrics-daemon-vgxd7\" (UID: \"b1ee9cce-c279-478f-8ca0-dd6bae1ad007\") " pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:05:48.992425 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:48.992391 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ws4d4\"" Jul 09 18:05:49.000444 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.000369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgxd7" Jul 09 18:05:49.100752 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.100688 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f6996c57-zlrqq"] Jul 09 18:05:49.102756 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:49.102720 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b715ea_6b8b_4ee0_8f1f_6b6913c4c81f.slice/crio-4b47ba7a938b8d4208fb379225f50f3cc93cebba1c8c79fbd6cd93a43f25f338 WatchSource:0}: Error finding container 4b47ba7a938b8d4208fb379225f50f3cc93cebba1c8c79fbd6cd93a43f25f338: Status 404 returned error can't find the container with id 4b47ba7a938b8d4208fb379225f50f3cc93cebba1c8c79fbd6cd93a43f25f338 Jul 09 18:05:49.167554 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.167520 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vgxd7"] Jul 09 18:05:49.170719 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:49.170693 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ee9cce_c279_478f_8ca0_dd6bae1ad007.slice/crio-ee4e5f60b2146d70ba3481fd63c1b6cd947692c7cfa7cfd86e78f6ac843dd034 WatchSource:0}: Error finding container ee4e5f60b2146d70ba3481fd63c1b6cd947692c7cfa7cfd86e78f6ac843dd034: Status 404 returned error can't find the container with id ee4e5f60b2146d70ba3481fd63c1b6cd947692c7cfa7cfd86e78f6ac843dd034 Jul 09 18:05:49.713679 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.713619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6996c57-zlrqq" event={"ID":"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f","Type":"ContainerStarted","Data":"4b47ba7a938b8d4208fb379225f50f3cc93cebba1c8c79fbd6cd93a43f25f338"} Jul 09 18:05:49.717771 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.717543 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dbh4x" event={"ID":"22b2465d-c63c-49aa-93bb-5dd1cc5c2704","Type":"ContainerStarted","Data":"0e4194a53bb6f46851c7b28892ad8c8b346ef97386f5fc60f61dddf63491d99a"} Jul 09 18:05:49.718739 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.718618 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:49.721715 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.721677 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vgxd7" event={"ID":"b1ee9cce-c279-478f-8ca0-dd6bae1ad007","Type":"ContainerStarted","Data":"ee4e5f60b2146d70ba3481fd63c1b6cd947692c7cfa7cfd86e78f6ac843dd034"} Jul 09 18:05:49.732085 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.731696 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-dbh4x" Jul 09 18:05:49.750012 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:49.749826 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-dbh4x" podStartSLOduration=1.378655103 podStartE2EDuration="17.749806671s" totalImagesPullingTime="16.371151568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:49.748471965 +0000 UTC m=+131.206288509" watchObservedRunningTime="2026-07-09 18:05:49.749806671 +0000 UTC m=+131.207623203" Jul 09 18:05:50.729355 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:50.729318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vgxd7" event={"ID":"b1ee9cce-c279-478f-8ca0-dd6bae1ad007","Type":"ContainerStarted","Data":"6ec8502c640d5fa094566ca9ba6a1bf1cead70743ae33aba8bc8c28da12b3c51"} Jul 09 18:05:50.729897 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:50.729382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vgxd7" event={"ID":"b1ee9cce-c279-478f-8ca0-dd6bae1ad007","Type":"ContainerStarted","Data":"0df464064cd890d68656e8f24b46df7ed680a4f7a55b9a1f18435d47eb787fd2"} Jul 09 18:05:50.749143 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:50.749079 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vgxd7" podStartSLOduration=129.59991135799999 podStartE2EDuration="2m10.749057978s" totalImagesPullingTime="1.14914662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:50.747204572 +0000 UTC m=+132.205021105" watchObservedRunningTime="2026-07-09 18:05:50.749057978 +0000 UTC m=+132.206874511" Jul 09 18:05:50.854617 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:50.854530 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:50.925339 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:50.925298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:52.835604 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.835566 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d758679c-6w8dx"] Jul 09 18:05:52.850326 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.850291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.852934 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.852904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d758679c-6w8dx"] Jul 09 18:05:52.858944 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.858911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 18:05:52.939458 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-oauth-config\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.939648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-service-ca\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.939648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-serving-cert\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.939648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-trusted-ca-bundle\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.939648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-oauth-serving-cert\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.939648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fm56\" (UniqueName: \"kubernetes.io/projected/4cf0a9fc-26e7-474a-a36b-b73c465478e3-kube-api-access-6fm56\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:52.939887 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:52.939762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-config\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.040845 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.040791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-serving-cert\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.041062 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.040891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-trusted-ca-bundle\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.041062 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.040913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-oauth-serving-cert\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.041062 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.040932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fm56\" (UniqueName: \"kubernetes.io/projected/4cf0a9fc-26e7-474a-a36b-b73c465478e3-kube-api-access-6fm56\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.041062 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.041004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-config\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.041062 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.041051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-oauth-config\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.041324 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.041080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-service-ca\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.042063 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.042016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-oauth-serving-cert\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.042187 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.042080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-config\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.042187 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.042130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-service-ca\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.042347 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.042321 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-trusted-ca-bundle\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.044207 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.044183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-serving-cert\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.044408 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.044382 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-oauth-config\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.050241 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.050217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fm56\" (UniqueName: \"kubernetes.io/projected/4cf0a9fc-26e7-474a-a36b-b73c465478e3-kube-api-access-6fm56\") pod \"console-57d758679c-6w8dx\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.163429 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.163382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:05:53.240827 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.240791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:53.342500 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.342450 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:53.360453 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.360404 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d758679c-6w8dx"] Jul 09 18:05:53.364904 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:05:53.364853 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf0a9fc_26e7_474a_a36b_b73c465478e3.slice/crio-84b1ae6c0635d50e2a1c31ece2714f22cdc9b31514b4e336106fceda97eee765 WatchSource:0}: Error finding container 84b1ae6c0635d50e2a1c31ece2714f22cdc9b31514b4e336106fceda97eee765: Status 404 returned error can't find the container with id 84b1ae6c0635d50e2a1c31ece2714f22cdc9b31514b4e336106fceda97eee765 Jul 09 18:05:53.443798 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.443681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:53.546834 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.546797 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:53.746101 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.745988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d758679c-6w8dx" event={"ID":"4cf0a9fc-26e7-474a-a36b-b73c465478e3","Type":"ContainerStarted","Data":"b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a"} Jul 09 18:05:53.746101 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.746070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d758679c-6w8dx" event={"ID":"4cf0a9fc-26e7-474a-a36b-b73c465478e3","Type":"ContainerStarted","Data":"84b1ae6c0635d50e2a1c31ece2714f22cdc9b31514b4e336106fceda97eee765"} Jul 09 18:05:53.747850 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.747825 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6996c57-zlrqq" event={"ID":"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f","Type":"ContainerStarted","Data":"c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a"} Jul 09 18:05:53.767873 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.767812 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57d758679c-6w8dx" podStartSLOduration=1.7677909139999999 podStartE2EDuration="1.767790914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:53.76574929 +0000 UTC m=+135.223565823" watchObservedRunningTime="2026-07-09 18:05:53.767790914 +0000 UTC m=+135.225607446" Jul 09 18:05:53.788804 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.788739 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f6996c57-zlrqq" podStartSLOduration=7.7157792480000005 podStartE2EDuration="11.788716115s" totalImagesPullingTime="4.072936867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:05:53.786905844 +0000 UTC m=+135.244722380" watchObservedRunningTime="2026-07-09 18:05:53.788716115 +0000 UTC m=+135.246532648" Jul 09 18:05:53.947464 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:53.947412 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" podUID="4f91815e-16fc-46c5-803c-69d17edf90c9" containerName="registry" containerID="cri-o://9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac" gracePeriod=30 Jul 09 18:05:54.219650 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.219616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:54.248564 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.248527 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:54.353661 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353575 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-installation-pull-secrets\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353661 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353627 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f91815e-16fc-46c5-803c-69d17edf90c9-ca-trust-extracted\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353661 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-image-registry-private-configuration\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353935 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353676 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djhjd\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-kube-api-access-djhjd\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353935 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353708 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353935 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353752 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-bound-sa-token\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353935 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353816 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-trusted-ca\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.353935 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.353847 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-certificates\") pod \"4f91815e-16fc-46c5-803c-69d17edf90c9\" (UID: \"4f91815e-16fc-46c5-803c-69d17edf90c9\") " Jul 09 18:05:54.354460 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.354426 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:05:54.354460 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.354442 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:05:54.356858 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.356802 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-kube-api-access-djhjd" (OuterVolumeSpecName: "kube-api-access-djhjd") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "kube-api-access-djhjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:05:54.357244 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.357215 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:05:54.357371 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.357348 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:05:54.357473 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.357446 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:05:54.357882 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.357856 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:05:54.364328 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.364293 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f91815e-16fc-46c5-803c-69d17edf90c9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f91815e-16fc-46c5-803c-69d17edf90c9" (UID: "4f91815e-16fc-46c5-803c-69d17edf90c9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:05:54.455320 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455276 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-image-registry-private-configuration\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455320 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455316 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djhjd\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-kube-api-access-djhjd\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455520 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455331 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-tls\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455520 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455347 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f91815e-16fc-46c5-803c-69d17edf90c9-bound-sa-token\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455520 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455361 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-trusted-ca\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455520 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455373 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f91815e-16fc-46c5-803c-69d17edf90c9-registry-certificates\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455520 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455390 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f91815e-16fc-46c5-803c-69d17edf90c9-installation-pull-secrets\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.455520 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.455401 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f91815e-16fc-46c5-803c-69d17edf90c9-ca-trust-extracted\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:05:54.753401 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.753350 2564 generic.go:356] "Generic (PLEG): container finished" podID="4f91815e-16fc-46c5-803c-69d17edf90c9" containerID="9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac" exitCode=0 Jul 09 18:05:54.753401 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.753403 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" Jul 09 18:05:54.753680 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.753418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" event={"ID":"4f91815e-16fc-46c5-803c-69d17edf90c9","Type":"ContainerDied","Data":"9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac"} Jul 09 18:05:54.753680 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.753484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58fbbddf8d-qcbgd" event={"ID":"4f91815e-16fc-46c5-803c-69d17edf90c9","Type":"ContainerDied","Data":"37a51475f0d07fd0e696f56d86d31c600949308d6fa67bfde3d8a39bc8684770"} Jul 09 18:05:54.753680 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.753520 2564 scope.go:117] "RemoveContainer" containerID="9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac" Jul 09 18:05:54.763668 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.763647 2564 scope.go:117] "RemoveContainer" containerID="9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac" Jul 09 18:05:54.763969 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:05:54.763939 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac\": container with ID starting with 9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac not found: ID does not exist" containerID="9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac" Jul 09 18:05:54.764076 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.763978 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac"} err="failed to get container status \"9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac\": rpc error: code = NotFound desc = could not find container \"9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac\": container with ID starting with 9d74b6eec2bd683aec77c17595029c09bf01c2403834106f34f90e7889a67fac not found: ID does not exist" Jul 09 18:05:54.776998 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.776966 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58fbbddf8d-qcbgd"] Jul 09 18:05:54.780758 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:54.780728 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58fbbddf8d-qcbgd"] Jul 09 18:05:55.062048 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:55.061953 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f91815e-16fc-46c5-803c-69d17edf90c9" path="/var/lib/kubelet/pods/4f91815e-16fc-46c5-803c-69d17edf90c9/volumes" Jul 09 18:05:55.179547 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:55.179513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:05:59.776773 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:59.776737 2564 generic.go:356] "Generic (PLEG): container finished" podID="7e4ee00e-9f1a-4083-95c8-601ce2c001f8" containerID="0c88fc622095709fde56e2fe6c824cb9238671c1479e3239b6b600fbac608a45" exitCode=0 Jul 09 18:05:59.777341 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:59.776816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" event={"ID":"7e4ee00e-9f1a-4083-95c8-601ce2c001f8","Type":"ContainerDied","Data":"0c88fc622095709fde56e2fe6c824cb9238671c1479e3239b6b600fbac608a45"} Jul 09 18:05:59.777341 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:05:59.777250 2564 scope.go:117] "RemoveContainer" containerID="0c88fc622095709fde56e2fe6c824cb9238671c1479e3239b6b600fbac608a45" Jul 09 18:06:00.790308 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:00.790262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pd4tl" event={"ID":"7e4ee00e-9f1a-4083-95c8-601ce2c001f8","Type":"ContainerStarted","Data":"940be09b1c7cf9f7496bffa95601a9b518555edacab4de82fe0c15b7a6c9c166"} Jul 09 18:06:02.833802 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:02.833765 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:06:02.834251 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:02.833826 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:06:02.838455 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:02.838434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:06:03.164462 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:03.164426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:06:03.164629 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:03.164508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:06:03.169103 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:03.169083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:06:03.806111 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:03.806070 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:06:03.806397 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:03.806381 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:06:03.881119 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:03.881082 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f6996c57-zlrqq"] Jul 09 18:06:04.862888 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:04.862848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:04.930697 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:04.930665 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:05.453770 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:05.453727 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:05.524833 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:05.524798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:23.414908 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:23.414869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:23.513447 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:23.513407 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:30.830583 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:30.830465 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67f6996c57-zlrqq" podUID="d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" containerName="console" containerID="cri-o://c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a" gracePeriod=15 Jul 09 18:06:31.098099 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.098009 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:06:31.249392 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249364 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-oauth-config\") pod \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " Jul 09 18:06:31.249572 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-service-ca\") pod \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " Jul 09 18:06:31.249572 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249559 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mjzl\" (UniqueName: \"kubernetes.io/projected/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-kube-api-access-5mjzl\") pod \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " Jul 09 18:06:31.249655 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249606 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-oauth-serving-cert\") pod \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " Jul 09 18:06:31.249655 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249634 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-serving-cert\") pod \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " Jul 09 18:06:31.249727 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249669 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-config\") pod \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\" (UID: \"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f\") " Jul 09 18:06:31.249927 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.249848 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" (UID: "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:31.250098 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.250069 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" (UID: "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:31.250155 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.250099 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-config" (OuterVolumeSpecName: "console-config") pod "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" (UID: "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:31.251897 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.251864 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-kube-api-access-5mjzl" (OuterVolumeSpecName: "kube-api-access-5mjzl") pod "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" (UID: "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f"). InnerVolumeSpecName "kube-api-access-5mjzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:06:31.251897 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.251875 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" (UID: "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:06:31.252013 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.251895 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" (UID: "d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:06:31.351315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.351215 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mjzl\" (UniqueName: \"kubernetes.io/projected/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-kube-api-access-5mjzl\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:06:31.351315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.351253 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-oauth-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:06:31.351315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.351263 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:06:31.351315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.351273 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:06:31.351315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.351281 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-console-oauth-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:06:31.351315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.351289 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f-service-ca\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:06:31.903641 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.903604 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" containerID="c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a" exitCode=0 Jul 09 18:06:31.904063 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.903651 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6996c57-zlrqq" Jul 09 18:06:31.904063 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.903702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6996c57-zlrqq" event={"ID":"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f","Type":"ContainerDied","Data":"c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a"} Jul 09 18:06:31.904063 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.903751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6996c57-zlrqq" event={"ID":"d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f","Type":"ContainerDied","Data":"4b47ba7a938b8d4208fb379225f50f3cc93cebba1c8c79fbd6cd93a43f25f338"} Jul 09 18:06:31.904063 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.903775 2564 scope.go:117] "RemoveContainer" containerID="c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a" Jul 09 18:06:31.912548 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.912526 2564 scope.go:117] "RemoveContainer" containerID="c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a" Jul 09 18:06:31.912799 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:06:31.912780 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a\": container with ID starting with c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a not found: ID does not exist" containerID="c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a" Jul 09 18:06:31.912871 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.912807 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a"} err="failed to get container status \"c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a\": rpc error: code = NotFound desc = could not find container \"c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a\": container with ID starting with c4a7906e5a6d1ae56afa3aaed455eb6555343f7de7abb0671a2beb7e0bc51e9a not found: ID does not exist" Jul 09 18:06:31.926116 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.926083 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f6996c57-zlrqq"] Jul 09 18:06:31.934997 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:31.934969 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f6996c57-zlrqq"] Jul 09 18:06:33.064849 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:33.062505 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" path="/var/lib/kubelet/pods/d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f/volumes" Jul 09 18:06:40.442683 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:40.442641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:40.774862 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:40.774777 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:50.426282 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426244 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79df9c5cdb-h7mkj"] Jul 09 18:06:50.426648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426521 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f91815e-16fc-46c5-803c-69d17edf90c9" containerName="registry" Jul 09 18:06:50.426648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426533 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f91815e-16fc-46c5-803c-69d17edf90c9" containerName="registry" Jul 09 18:06:50.426648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426553 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" containerName="console" Jul 09 18:06:50.426648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426562 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" containerName="console" Jul 09 18:06:50.426648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426605 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b715ea-6b8b-4ee0-8f1f-6b6913c4c81f" containerName="console" Jul 09 18:06:50.426648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.426612 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f91815e-16fc-46c5-803c-69d17edf90c9" containerName="registry" Jul 09 18:06:50.429245 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.429228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.440703 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.440673 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79df9c5cdb-h7mkj"] Jul 09 18:06:50.490608 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-service-ca\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.490782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-oauth-config\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.490782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-trusted-ca-bundle\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.490782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-oauth-serving-cert\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.490782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490746 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-config\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.490782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrj7p\" (UniqueName: \"kubernetes.io/projected/bc20d992-b9df-4c8e-b39c-0474e5b7f830-kube-api-access-jrj7p\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.490974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.490825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-serving-cert\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592148 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-serving-cert\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592148 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-service-ca\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592414 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-oauth-config\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592414 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-trusted-ca-bundle\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592414 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-oauth-serving-cert\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592414 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-config\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.592414 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrj7p\" (UniqueName: \"kubernetes.io/projected/bc20d992-b9df-4c8e-b39c-0474e5b7f830-kube-api-access-jrj7p\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.593066 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.592927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-service-ca\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.593208 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.593110 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-oauth-serving-cert\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.593208 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.593108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-config\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.593345 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.593325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-trusted-ca-bundle\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.594768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.594744 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-serving-cert\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.594899 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.594878 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-oauth-config\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.601267 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.601237 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrj7p\" (UniqueName: \"kubernetes.io/projected/bc20d992-b9df-4c8e-b39c-0474e5b7f830-kube-api-access-jrj7p\") pod \"console-79df9c5cdb-h7mkj\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.739069 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.738953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:06:50.874955 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.873883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79df9c5cdb-h7mkj"] Jul 09 18:06:50.973315 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.973274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79df9c5cdb-h7mkj" event={"ID":"bc20d992-b9df-4c8e-b39c-0474e5b7f830","Type":"ContainerStarted","Data":"a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70"} Jul 09 18:06:50.973505 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.973339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79df9c5cdb-h7mkj" event={"ID":"bc20d992-b9df-4c8e-b39c-0474e5b7f830","Type":"ContainerStarted","Data":"663d655cfc9af339f59585750e4358929cd097d5d72fa086ea867dc3386a7784"} Jul 09 18:06:50.991636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:50.991535 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79df9c5cdb-h7mkj" podStartSLOduration=0.991517368 podStartE2EDuration="991.517368ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:06:50.990961092 +0000 UTC m=+192.448777627" watchObservedRunningTime="2026-07-09 18:06:50.991517368 +0000 UTC m=+192.449333900" Jul 09 18:06:52.487305 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:52.487274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:52.542724 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:52.542693 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:54.373715 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:54.373668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:06:57.016885 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:06:57.016854 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:00.740013 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:00.739969 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:07:00.740433 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:00.740069 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:07:00.744852 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:00.744823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:07:01.013687 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:01.013603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:07:01.061417 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:01.061384 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d758679c-6w8dx"] Jul 09 18:07:01.172185 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:01.172150 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:01.233629 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:01.233593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:01.296992 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:01.296902 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:19.344456 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:19.344414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:19.401807 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:19.401767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:26.090727 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.090679 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57d758679c-6w8dx" podUID="4cf0a9fc-26e7-474a-a36b-b73c465478e3" containerName="console" containerID="cri-o://b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a" gracePeriod=15 Jul 09 18:07:26.331756 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.331729 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:07:26.489128 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489093 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fm56\" (UniqueName: \"kubernetes.io/projected/4cf0a9fc-26e7-474a-a36b-b73c465478e3-kube-api-access-6fm56\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489133 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-oauth-serving-cert\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489166 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-trusted-ca-bundle\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489200 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-config\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489236 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-service-ca\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489262 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-oauth-config\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489288 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-serving-cert\") pod \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\" (UID: \"4cf0a9fc-26e7-474a-a36b-b73c465478e3\") " Jul 09 18:07:26.489705 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489675 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:26.489843 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489725 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:26.489843 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489771 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-config" (OuterVolumeSpecName: "console-config") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:26.489843 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.489815 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:26.491463 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.491438 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf0a9fc-26e7-474a-a36b-b73c465478e3-kube-api-access-6fm56" (OuterVolumeSpecName: "kube-api-access-6fm56") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "kube-api-access-6fm56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:26.491631 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.491609 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:26.491692 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.491653 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4cf0a9fc-26e7-474a-a36b-b73c465478e3" (UID: "4cf0a9fc-26e7-474a-a36b-b73c465478e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:07:26.589940 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589906 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fm56\" (UniqueName: \"kubernetes.io/projected/4cf0a9fc-26e7-474a-a36b-b73c465478e3-kube-api-access-6fm56\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:26.589940 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589934 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-oauth-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:26.589940 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589943 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-trusted-ca-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:26.590195 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589956 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:26.590195 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589965 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cf0a9fc-26e7-474a-a36b-b73c465478e3-service-ca\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:26.590195 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589973 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-oauth-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:26.590195 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:26.589984 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf0a9fc-26e7-474a-a36b-b73c465478e3-console-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.100677 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.100640 2564 generic.go:356] "Generic (PLEG): container finished" podID="4cf0a9fc-26e7-474a-a36b-b73c465478e3" containerID="b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a" exitCode=0 Jul 09 18:07:27.101092 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.100687 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d758679c-6w8dx" Jul 09 18:07:27.101092 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.100726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d758679c-6w8dx" event={"ID":"4cf0a9fc-26e7-474a-a36b-b73c465478e3","Type":"ContainerDied","Data":"b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a"} Jul 09 18:07:27.101092 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.100771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d758679c-6w8dx" event={"ID":"4cf0a9fc-26e7-474a-a36b-b73c465478e3","Type":"ContainerDied","Data":"84b1ae6c0635d50e2a1c31ece2714f22cdc9b31514b4e336106fceda97eee765"} Jul 09 18:07:27.101092 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.100791 2564 scope.go:117] "RemoveContainer" containerID="b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a" Jul 09 18:07:27.108716 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.108696 2564 scope.go:117] "RemoveContainer" containerID="b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a" Jul 09 18:07:27.108959 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:07:27.108939 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a\": container with ID starting with b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a not found: ID does not exist" containerID="b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a" Jul 09 18:07:27.109004 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.108969 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a"} err="failed to get container status \"b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a\": rpc error: code = NotFound desc = could not find container \"b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a\": container with ID starting with b13a0915908d6a18d608e8f2121c3895e595c36ff35275f019a25e1985303f5a not found: ID does not exist" Jul 09 18:07:27.120661 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.120641 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d758679c-6w8dx"] Jul 09 18:07:27.124274 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:27.124254 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57d758679c-6w8dx"] Jul 09 18:07:29.061089 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:29.061059 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cf0a9fc-26e7-474a-a36b-b73c465478e3" path="/var/lib/kubelet/pods/4cf0a9fc-26e7-474a-a36b-b73c465478e3/volumes" Jul 09 18:07:55.363184 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:55.363149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:55.735227 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:55.735195 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:07:55.799792 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:07:55.799755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:07.613227 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:07.613133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:07.673234 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:07.673196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:14.614456 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.614424 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5644488cff-lv2l2"] Jul 09 18:08:14.614985 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.614727 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf0a9fc-26e7-474a-a36b-b73c465478e3" containerName="console" Jul 09 18:08:14.614985 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.614741 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf0a9fc-26e7-474a-a36b-b73c465478e3" containerName="console" Jul 09 18:08:14.614985 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.614797 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf0a9fc-26e7-474a-a36b-b73c465478e3" containerName="console" Jul 09 18:08:14.621530 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.621503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.627893 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.627864 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5644488cff-lv2l2"] Jul 09 18:08:14.678128 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.678096 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:14.736507 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.736473 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:14.738510 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-service-ca\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.738573 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-console-config\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.738573 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-trusted-ca-bundle\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.738637 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-oauth-serving-cert\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.738637 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7bg\" (UniqueName: \"kubernetes.io/projected/5daf1821-eb75-4df5-a561-3804452e74d9-kube-api-access-tp7bg\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.738704 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-serving-cert\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.738704 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.738681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-oauth-config\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839533 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-oauth-config\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839533 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-service-ca\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-console-config\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-trusted-ca-bundle\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-oauth-serving-cert\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7bg\" (UniqueName: \"kubernetes.io/projected/5daf1821-eb75-4df5-a561-3804452e74d9-kube-api-access-tp7bg\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.839763 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.839663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-serving-cert\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.840399 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.840372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-service-ca\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.840523 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.840372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-oauth-serving-cert\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.840568 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.840516 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-trusted-ca-bundle\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.840623 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.840595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-console-config\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.842296 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.842277 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-serving-cert\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.842584 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.842569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-oauth-config\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.847936 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.847916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7bg\" (UniqueName: \"kubernetes.io/projected/5daf1821-eb75-4df5-a561-3804452e74d9-kube-api-access-tp7bg\") pod \"console-5644488cff-lv2l2\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:14.933389 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:14.933349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:15.067737 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:15.067702 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5644488cff-lv2l2"] Jul 09 18:08:15.070416 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:08:15.070372 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daf1821_eb75_4df5_a561_3804452e74d9.slice/crio-a96b1f7c56cf327a6b3099c9f99cfaf9c29fc76fa471650c4b021c317850d29d WatchSource:0}: Error finding container a96b1f7c56cf327a6b3099c9f99cfaf9c29fc76fa471650c4b021c317850d29d: Status 404 returned error can't find the container with id a96b1f7c56cf327a6b3099c9f99cfaf9c29fc76fa471650c4b021c317850d29d Jul 09 18:08:15.267105 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:15.266998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644488cff-lv2l2" event={"ID":"5daf1821-eb75-4df5-a561-3804452e74d9","Type":"ContainerStarted","Data":"0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996"} Jul 09 18:08:15.267105 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:15.267072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644488cff-lv2l2" event={"ID":"5daf1821-eb75-4df5-a561-3804452e74d9","Type":"ContainerStarted","Data":"a96b1f7c56cf327a6b3099c9f99cfaf9c29fc76fa471650c4b021c317850d29d"} Jul 09 18:08:15.287691 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:15.287613 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5644488cff-lv2l2" podStartSLOduration=1.287592613 podStartE2EDuration="1.287592613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:08:15.286934163 +0000 UTC m=+276.744750694" watchObservedRunningTime="2026-07-09 18:08:15.287592613 +0000 UTC m=+276.745409146" Jul 09 18:08:23.425240 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:23.425205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:23.523798 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:23.523749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:24.934261 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:24.934232 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:24.934651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:24.934535 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:24.939098 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:24.939077 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:25.303713 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:25.303627 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:08:25.353645 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:25.353611 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79df9c5cdb-h7mkj"] Jul 09 18:08:25.463596 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:25.463514 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:25.576053 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:25.575940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:25.630691 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:25.630653 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:08:38.926601 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:38.926571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:08:38.929839 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:38.929817 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:08:38.936531 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:38.936511 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 18:08:38.938322 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:38.938299 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:08:38.947657 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:38.947632 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:08:50.381787 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.381715 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79df9c5cdb-h7mkj" podUID="bc20d992-b9df-4c8e-b39c-0474e5b7f830" containerName="console" containerID="cri-o://a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70" gracePeriod=15 Jul 09 18:08:50.622127 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.622104 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:08:50.720739 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720710 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-trusted-ca-bundle\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.720943 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720768 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-service-ca\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.720943 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720790 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-serving-cert\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.720943 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720811 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-oauth-serving-cert\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.720943 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720836 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-oauth-config\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.720943 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720867 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-config\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.720943 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.720885 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrj7p\" (UniqueName: \"kubernetes.io/projected/bc20d992-b9df-4c8e-b39c-0474e5b7f830-kube-api-access-jrj7p\") pod \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\" (UID: \"bc20d992-b9df-4c8e-b39c-0474e5b7f830\") " Jul 09 18:08:50.721357 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.721318 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:50.721357 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.721339 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:50.721484 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.721361 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-service-ca" (OuterVolumeSpecName: "service-ca") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:50.721484 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.721429 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-config" (OuterVolumeSpecName: "console-config") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:50.723218 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.723179 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc20d992-b9df-4c8e-b39c-0474e5b7f830-kube-api-access-jrj7p" (OuterVolumeSpecName: "kube-api-access-jrj7p") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "kube-api-access-jrj7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:08:50.723317 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.723225 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:08:50.723317 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.723250 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bc20d992-b9df-4c8e-b39c-0474e5b7f830" (UID: "bc20d992-b9df-4c8e-b39c-0474e5b7f830"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:08:50.822423 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822384 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrj7p\" (UniqueName: \"kubernetes.io/projected/bc20d992-b9df-4c8e-b39c-0474e5b7f830-kube-api-access-jrj7p\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:50.822423 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822418 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-trusted-ca-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:50.822423 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822430 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-service-ca\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:50.822658 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822441 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:50.822658 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822452 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-oauth-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:50.822658 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822463 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-oauth-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:50.822658 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:50.822474 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bc20d992-b9df-4c8e-b39c-0474e5b7f830-console-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:08:51.389383 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.389293 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc20d992-b9df-4c8e-b39c-0474e5b7f830" containerID="a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70" exitCode=0 Jul 09 18:08:51.389383 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.389347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79df9c5cdb-h7mkj" event={"ID":"bc20d992-b9df-4c8e-b39c-0474e5b7f830","Type":"ContainerDied","Data":"a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70"} Jul 09 18:08:51.389383 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.389356 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79df9c5cdb-h7mkj" Jul 09 18:08:51.389891 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.389429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79df9c5cdb-h7mkj" event={"ID":"bc20d992-b9df-4c8e-b39c-0474e5b7f830","Type":"ContainerDied","Data":"663d655cfc9af339f59585750e4358929cd097d5d72fa086ea867dc3386a7784"} Jul 09 18:08:51.389891 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.389459 2564 scope.go:117] "RemoveContainer" containerID="a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70" Jul 09 18:08:51.397576 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.397556 2564 scope.go:117] "RemoveContainer" containerID="a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70" Jul 09 18:08:51.397848 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:08:51.397828 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70\": container with ID starting with a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70 not found: ID does not exist" containerID="a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70" Jul 09 18:08:51.397911 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.397862 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70"} err="failed to get container status \"a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70\": rpc error: code = NotFound desc = could not find container \"a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70\": container with ID starting with a1d23d7e33b13d49efe5065f3c312757de54f942d68fd5d4514689bb04423c70 not found: ID does not exist" Jul 09 18:08:51.405366 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.405344 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79df9c5cdb-h7mkj"] Jul 09 18:08:51.411358 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:51.411337 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79df9c5cdb-h7mkj"] Jul 09 18:08:53.061077 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:08:53.061022 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc20d992-b9df-4c8e-b39c-0474e5b7f830" path="/var/lib/kubelet/pods/bc20d992-b9df-4c8e-b39c-0474e5b7f830/volumes" Jul 09 18:09:39.085946 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:09:39.085901 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:09:40.359269 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:09:40.359228 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:10:35.942194 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.942162 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm"] Jul 09 18:10:35.942663 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.942420 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc20d992-b9df-4c8e-b39c-0474e5b7f830" containerName="console" Jul 09 18:10:35.942663 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.942430 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc20d992-b9df-4c8e-b39c-0474e5b7f830" containerName="console" Jul 09 18:10:35.942663 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.942473 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc20d992-b9df-4c8e-b39c-0474e5b7f830" containerName="console" Jul 09 18:10:35.944442 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.944425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:35.947147 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.947125 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 18:10:35.948169 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.948148 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q9qsj\"" Jul 09 18:10:35.948286 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.948204 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 18:10:35.987787 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.987755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:35.987787 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.987793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24bk\" (UniqueName: \"kubernetes.io/projected/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-kube-api-access-q24bk\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:35.988015 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.987816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:35.995016 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:35.994978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm"] Jul 09 18:10:36.088812 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.088778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.089008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.088827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24bk\" (UniqueName: \"kubernetes.io/projected/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-kube-api-access-q24bk\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.089008 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.088861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.089178 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.089155 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.089258 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.089237 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.097160 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.097136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24bk\" (UniqueName: \"kubernetes.io/projected/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-kube-api-access-q24bk\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.253612 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.253509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:36.382264 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.382232 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm"] Jul 09 18:10:36.385426 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:10:36.385395 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a3cce5_30c9_47ba_a745_8ffac0da2fc1.slice/crio-64ac0d20e94541dfab5fc87d8ac9b415c1f26aa72e3a6923ef02c4587c3dc3a6 WatchSource:0}: Error finding container 64ac0d20e94541dfab5fc87d8ac9b415c1f26aa72e3a6923ef02c4587c3dc3a6: Status 404 returned error can't find the container with id 64ac0d20e94541dfab5fc87d8ac9b415c1f26aa72e3a6923ef02c4587c3dc3a6 Jul 09 18:10:36.387226 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.387209 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 18:10:36.751707 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:36.751663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" event={"ID":"08a3cce5-30c9-47ba-a745-8ffac0da2fc1","Type":"ContainerStarted","Data":"64ac0d20e94541dfab5fc87d8ac9b415c1f26aa72e3a6923ef02c4587c3dc3a6"} Jul 09 18:10:38.318442 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:38.318410 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:10:44.784350 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:44.784317 2564 generic.go:356] "Generic (PLEG): container finished" podID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerID="3c26bb510842832f86d3e632cf2755295903c411ea0ca26fb45901e6889c74cd" exitCode=0 Jul 09 18:10:44.784786 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:44.784407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" event={"ID":"08a3cce5-30c9-47ba-a745-8ffac0da2fc1","Type":"ContainerDied","Data":"3c26bb510842832f86d3e632cf2755295903c411ea0ca26fb45901e6889c74cd"} Jul 09 18:10:46.793871 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:46.793838 2564 generic.go:356] "Generic (PLEG): container finished" podID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerID="850888870a3ef5caa26e1838fb6ae56fd6732abb0aaacc92bac8da1a25b9d191" exitCode=0 Jul 09 18:10:46.794224 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:46.793931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" event={"ID":"08a3cce5-30c9-47ba-a745-8ffac0da2fc1","Type":"ContainerDied","Data":"850888870a3ef5caa26e1838fb6ae56fd6732abb0aaacc92bac8da1a25b9d191"} Jul 09 18:10:56.836102 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:56.836063 2564 generic.go:356] "Generic (PLEG): container finished" podID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerID="8116cdb969ed9b690b659ba7769f287c125971dd6ffb0e55fc762673424c026b" exitCode=0 Jul 09 18:10:56.836543 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:56.836124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" event={"ID":"08a3cce5-30c9-47ba-a745-8ffac0da2fc1","Type":"ContainerDied","Data":"8116cdb969ed9b690b659ba7769f287c125971dd6ffb0e55fc762673424c026b"} Jul 09 18:10:57.878627 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:57.878589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:10:57.979564 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:57.979522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:10:58.002795 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.002762 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:58.067072 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.067009 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q24bk\" (UniqueName: \"kubernetes.io/projected/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-kube-api-access-q24bk\") pod \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " Jul 09 18:10:58.067072 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.067077 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-util\") pod \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " Jul 09 18:10:58.067270 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.067120 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-bundle\") pod \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\" (UID: \"08a3cce5-30c9-47ba-a745-8ffac0da2fc1\") " Jul 09 18:10:58.067718 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.067689 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-bundle" (OuterVolumeSpecName: "bundle") pod "08a3cce5-30c9-47ba-a745-8ffac0da2fc1" (UID: "08a3cce5-30c9-47ba-a745-8ffac0da2fc1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:10:58.069342 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.069319 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-kube-api-access-q24bk" (OuterVolumeSpecName: "kube-api-access-q24bk") pod "08a3cce5-30c9-47ba-a745-8ffac0da2fc1" (UID: "08a3cce5-30c9-47ba-a745-8ffac0da2fc1"). InnerVolumeSpecName "kube-api-access-q24bk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:10:58.072888 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.072858 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-util" (OuterVolumeSpecName: "util") pod "08a3cce5-30c9-47ba-a745-8ffac0da2fc1" (UID: "08a3cce5-30c9-47ba-a745-8ffac0da2fc1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:10:58.167986 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.167957 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q24bk\" (UniqueName: \"kubernetes.io/projected/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-kube-api-access-q24bk\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:10:58.167986 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.167987 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:10:58.168191 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.167996 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08a3cce5-30c9-47ba-a745-8ffac0da2fc1-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:10:58.845263 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.845233 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" Jul 09 18:10:58.845263 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.845245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589hsfqm" event={"ID":"08a3cce5-30c9-47ba-a745-8ffac0da2fc1","Type":"ContainerDied","Data":"64ac0d20e94541dfab5fc87d8ac9b415c1f26aa72e3a6923ef02c4587c3dc3a6"} Jul 09 18:10:58.845473 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:10:58.845288 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ac0d20e94541dfab5fc87d8ac9b415c1f26aa72e3a6923ef02c4587c3dc3a6" Jul 09 18:11:02.360489 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:02.360402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:02.456682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:02.456652 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:04.526319 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526284 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b"] Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526539 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="pull" Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526550 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="pull" Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526559 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="util" Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526565 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="util" Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526573 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="extract" Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526579 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="extract" Jul 09 18:11:04.526682 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.526622 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08a3cce5-30c9-47ba-a745-8ffac0da2fc1" containerName="extract" Jul 09 18:11:04.528376 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.528361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.531185 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.531161 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 09 18:11:04.531334 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.531259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2b8dp\"" Jul 09 18:11:04.531624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.531609 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 09 18:11:04.531796 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.531774 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 09 18:11:04.544229 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.544210 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b"] Jul 09 18:11:04.618243 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.618210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6ttt\" (UniqueName: \"kubernetes.io/projected/c7262671-0031-45b4-a17b-1a94e5e67f3d-kube-api-access-r6ttt\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b\" (UID: \"c7262671-0031-45b4-a17b-1a94e5e67f3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.618243 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.618246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c7262671-0031-45b4-a17b-1a94e5e67f3d-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b\" (UID: \"c7262671-0031-45b4-a17b-1a94e5e67f3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.719161 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.719131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ttt\" (UniqueName: \"kubernetes.io/projected/c7262671-0031-45b4-a17b-1a94e5e67f3d-kube-api-access-r6ttt\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b\" (UID: \"c7262671-0031-45b4-a17b-1a94e5e67f3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.719300 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.719166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c7262671-0031-45b4-a17b-1a94e5e67f3d-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b\" (UID: \"c7262671-0031-45b4-a17b-1a94e5e67f3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.721593 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.721561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c7262671-0031-45b4-a17b-1a94e5e67f3d-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b\" (UID: \"c7262671-0031-45b4-a17b-1a94e5e67f3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.731042 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.731003 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6ttt\" (UniqueName: \"kubernetes.io/projected/c7262671-0031-45b4-a17b-1a94e5e67f3d-kube-api-access-r6ttt\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b\" (UID: \"c7262671-0031-45b4-a17b-1a94e5e67f3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.838270 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.838177 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:04.999120 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:11:04.999081 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7262671_0031_45b4_a17b_1a94e5e67f3d.slice/crio-746a093839567fd55bce3dc940ee981be308f5b2d3a9dfd7475036c9235dcd70 WatchSource:0}: Error finding container 746a093839567fd55bce3dc940ee981be308f5b2d3a9dfd7475036c9235dcd70: Status 404 returned error can't find the container with id 746a093839567fd55bce3dc940ee981be308f5b2d3a9dfd7475036c9235dcd70 Jul 09 18:11:04.999600 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:04.999578 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b"] Jul 09 18:11:05.872211 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:05.872175 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" event={"ID":"c7262671-0031-45b4-a17b-1a94e5e67f3d","Type":"ContainerStarted","Data":"746a093839567fd55bce3dc940ee981be308f5b2d3a9dfd7475036c9235dcd70"} Jul 09 18:11:07.880794 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:07.880712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" event={"ID":"c7262671-0031-45b4-a17b-1a94e5e67f3d","Type":"ContainerStarted","Data":"9b1a718cb529a0856f07d265d47ca7a03845e852f22a953dbbceb3b301b7ffda"} Jul 09 18:11:07.881172 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:07.880853 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:07.910592 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:07.910547 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" podStartSLOduration=1.376387192 podStartE2EDuration="3.910531703s" totalImagesPullingTime="2.534144511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:07.907925485 +0000 UTC m=+449.365742016" watchObservedRunningTime="2026-07-09 18:11:07.910531703 +0000 UTC m=+449.368348235" Jul 09 18:11:08.107227 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.107193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:08.306478 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.306357 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-p28kr"] Jul 09 18:11:08.308585 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.308564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.310352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.310324 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:08.311409 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.311386 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 09 18:11:08.311409 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.311399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 09 18:11:08.311559 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.311426 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-dv69n\"" Jul 09 18:11:08.323701 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.323681 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-p28kr"] Jul 09 18:11:08.453359 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.453322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l44sb\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-kube-api-access-l44sb\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.453359 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.453357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/9da558fc-f95d-46a3-a172-eb0a13902e81-cabundle0\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.453594 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.453384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-certificates\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.554527 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.554497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-certificates\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.554709 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.554563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l44sb\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-kube-api-access-l44sb\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.554709 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.554593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/9da558fc-f95d-46a3-a172-eb0a13902e81-cabundle0\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.554709 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:11:08.554669 2564 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 09 18:11:08.554709 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:11:08.554692 2564 secret.go:281] references non-existent secret key: ca.crt Jul 09 18:11:08.554709 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:11:08.554704 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 09 18:11:08.554934 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:11:08.554719 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-p28kr: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 09 18:11:08.554934 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:11:08.554783 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-certificates podName:9da558fc-f95d-46a3-a172-eb0a13902e81 nodeName:}" failed. No retries permitted until 2026-07-09 18:11:09.054763459 +0000 UTC m=+450.512579985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-certificates") pod "keda-operator-68bff59c-p28kr" (UID: "9da558fc-f95d-46a3-a172-eb0a13902e81") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 09 18:11:08.555266 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.555249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/9da558fc-f95d-46a3-a172-eb0a13902e81-cabundle0\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.565779 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.565733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l44sb\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-kube-api-access-l44sb\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:08.739637 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.739598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:08.890134 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.890017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:08.958496 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.958462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-l8dch"] Jul 09 18:11:08.960420 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.960404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:08.963273 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.963252 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 09 18:11:08.974131 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:08.974109 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-l8dch"] Jul 09 18:11:09.057923 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.057888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktc9v\" (UniqueName: \"kubernetes.io/projected/7b9484c8-51db-4756-b5fc-2f80ad3c2964-kube-api-access-ktc9v\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.058131 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.057979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/7b9484c8-51db-4756-b5fc-2f80ad3c2964-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.058131 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.058059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b9484c8-51db-4756-b5fc-2f80ad3c2964-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.058231 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.058141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-certificates\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:09.061083 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.061059 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9da558fc-f95d-46a3-a172-eb0a13902e81-certificates\") pod \"keda-operator-68bff59c-p28kr\" (UID: \"9da558fc-f95d-46a3-a172-eb0a13902e81\") " pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:09.100918 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.100886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:09.158928 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.158840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b9484c8-51db-4756-b5fc-2f80ad3c2964-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.158928 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.158892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktc9v\" (UniqueName: \"kubernetes.io/projected/7b9484c8-51db-4756-b5fc-2f80ad3c2964-kube-api-access-ktc9v\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.158928 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.158923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/7b9484c8-51db-4756-b5fc-2f80ad3c2964-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.159280 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.159262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/7b9484c8-51db-4756-b5fc-2f80ad3c2964-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.161470 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.161438 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/7b9484c8-51db-4756-b5fc-2f80ad3c2964-certificates\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.174936 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.174908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktc9v\" (UniqueName: \"kubernetes.io/projected/7b9484c8-51db-4756-b5fc-2f80ad3c2964-kube-api-access-ktc9v\") pod \"keda-metrics-apiserver-559f75f947-l8dch\" (UID: \"7b9484c8-51db-4756-b5fc-2f80ad3c2964\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.194044 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.194004 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-tc9jx"] Jul 09 18:11:09.196280 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.196265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.199651 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.199635 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 09 18:11:09.219455 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.219428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:09.223693 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.223670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-tc9jx"] Jul 09 18:11:09.260174 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.260143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eb95de37-7ac4-4694-b94c-0fab0043183c-certificates\") pod \"keda-admission-5fbd5c4644-tc9jx\" (UID: \"eb95de37-7ac4-4694-b94c-0fab0043183c\") " pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.260327 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.260209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqt5\" (UniqueName: \"kubernetes.io/projected/eb95de37-7ac4-4694-b94c-0fab0043183c-kube-api-access-kvqt5\") pod \"keda-admission-5fbd5c4644-tc9jx\" (UID: \"eb95de37-7ac4-4694-b94c-0fab0043183c\") " pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.270856 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.270429 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:09.296216 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.296148 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:09.364064 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.362887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqt5\" (UniqueName: \"kubernetes.io/projected/eb95de37-7ac4-4694-b94c-0fab0043183c-kube-api-access-kvqt5\") pod \"keda-admission-5fbd5c4644-tc9jx\" (UID: \"eb95de37-7ac4-4694-b94c-0fab0043183c\") " pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.364064 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.362975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eb95de37-7ac4-4694-b94c-0fab0043183c-certificates\") pod \"keda-admission-5fbd5c4644-tc9jx\" (UID: \"eb95de37-7ac4-4694-b94c-0fab0043183c\") " pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.371622 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.371590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eb95de37-7ac4-4694-b94c-0fab0043183c-certificates\") pod \"keda-admission-5fbd5c4644-tc9jx\" (UID: \"eb95de37-7ac4-4694-b94c-0fab0043183c\") " pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.387667 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.387540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqt5\" (UniqueName: \"kubernetes.io/projected/eb95de37-7ac4-4694-b94c-0fab0043183c-kube-api-access-kvqt5\") pod \"keda-admission-5fbd5c4644-tc9jx\" (UID: \"eb95de37-7ac4-4694-b94c-0fab0043183c\") " pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.395864 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.395834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-p28kr"] Jul 09 18:11:09.398624 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:11:09.398591 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da558fc_f95d_46a3_a172_eb0a13902e81.slice/crio-12af56c4b8b62d8125e2eca6249ead200707a739a2c09da590a5b24bfc1b9e99 WatchSource:0}: Error finding container 12af56c4b8b62d8125e2eca6249ead200707a739a2c09da590a5b24bfc1b9e99: Status 404 returned error can't find the container with id 12af56c4b8b62d8125e2eca6249ead200707a739a2c09da590a5b24bfc1b9e99 Jul 09 18:11:09.453629 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.453593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:09.459787 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.459763 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-l8dch"] Jul 09 18:11:09.474604 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:11:09.474577 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9484c8_51db_4756_b5fc_2f80ad3c2964.slice/crio-131a00064cb4808611e65baf606ba1b76011072ebd991214dbb59b5a453ff18b WatchSource:0}: Error finding container 131a00064cb4808611e65baf606ba1b76011072ebd991214dbb59b5a453ff18b: Status 404 returned error can't find the container with id 131a00064cb4808611e65baf606ba1b76011072ebd991214dbb59b5a453ff18b Jul 09 18:11:09.505492 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.505451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:09.652388 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.652226 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-tc9jx"] Jul 09 18:11:09.654823 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:11:09.654800 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb95de37_7ac4_4694_b94c_0fab0043183c.slice/crio-f5c45cacd579d1e2ebec0819d0e84d1fb3e83dea901003882ed851985cc37f88 WatchSource:0}: Error finding container f5c45cacd579d1e2ebec0819d0e84d1fb3e83dea901003882ed851985cc37f88: Status 404 returned error can't find the container with id f5c45cacd579d1e2ebec0819d0e84d1fb3e83dea901003882ed851985cc37f88 Jul 09 18:11:09.832234 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.832140 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:09.890749 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.890708 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" event={"ID":"7b9484c8-51db-4756-b5fc-2f80ad3c2964","Type":"ContainerStarted","Data":"131a00064cb4808611e65baf606ba1b76011072ebd991214dbb59b5a453ff18b"} Jul 09 18:11:09.891962 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.891935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" event={"ID":"eb95de37-7ac4-4694-b94c-0fab0043183c","Type":"ContainerStarted","Data":"f5c45cacd579d1e2ebec0819d0e84d1fb3e83dea901003882ed851985cc37f88"} Jul 09 18:11:09.892982 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:09.892962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-p28kr" event={"ID":"9da558fc-f95d-46a3-a172-eb0a13902e81","Type":"ContainerStarted","Data":"12af56c4b8b62d8125e2eca6249ead200707a739a2c09da590a5b24bfc1b9e99"} Jul 09 18:11:10.058664 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:10.058624 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:10.184630 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:10.184595 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:10.336410 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:10.336375 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:12.909111 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:12.909075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" event={"ID":"7b9484c8-51db-4756-b5fc-2f80ad3c2964","Type":"ContainerStarted","Data":"36c0d5e1e14a99346b4354ee335b8a3f92bc19ce74685107f4d4c284aed8985d"} Jul 09 18:11:12.909596 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:12.909169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:12.941923 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:12.941870 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" podStartSLOduration=2.278242156 podStartE2EDuration="4.941848599s" totalImagesPullingTime="2.663606443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:12.941663294 +0000 UTC m=+454.399479846" watchObservedRunningTime="2026-07-09 18:11:12.941848599 +0000 UTC m=+454.399665131" Jul 09 18:11:13.914562 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:13.914522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-p28kr" event={"ID":"9da558fc-f95d-46a3-a172-eb0a13902e81","Type":"ContainerStarted","Data":"a51a73a9b1cec4e1826327e352bf8accd2a1f00720aebcc7a0d8675d70a17796"} Jul 09 18:11:13.915073 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:13.914668 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:13.916078 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:13.916044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" event={"ID":"eb95de37-7ac4-4694-b94c-0fab0043183c","Type":"ContainerStarted","Data":"040e26ee0a49f37391856a638323cfa903f7b863c5f55111b657b0c83fec1124"} Jul 09 18:11:13.916240 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:13.916182 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:13.939928 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:13.939874 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-p28kr" podStartSLOduration=1.597109766 podStartE2EDuration="5.939860005s" totalImagesPullingTime="4.342750239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:13.938020158 +0000 UTC m=+455.395836691" watchObservedRunningTime="2026-07-09 18:11:13.939860005 +0000 UTC m=+455.397676560" Jul 09 18:11:13.978709 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:13.978655 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" podStartSLOduration=0.896987634 podStartE2EDuration="4.978633067s" totalImagesPullingTime="4.081645433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:13.97728179 +0000 UTC m=+455.435098322" watchObservedRunningTime="2026-07-09 18:11:13.978633067 +0000 UTC m=+455.436449601" Jul 09 18:11:14.894743 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:14.894708 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:23.922231 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:23.922198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-l8dch" Jul 09 18:11:28.887646 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:28.887607 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-wlw8b" Jul 09 18:11:34.922515 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:34.922481 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-p28kr" Jul 09 18:11:34.922974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:34.922567 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-tc9jx" Jul 09 18:11:54.360248 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.360204 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bdfcddf45-rpsv4"] Jul 09 18:11:54.367679 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.367656 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.380546 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.380519 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bdfcddf45-rpsv4"] Jul 09 18:11:54.425404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-console-config\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.425404 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjn4\" (UniqueName: \"kubernetes.io/projected/a89f4c0d-6b46-481c-9481-15a0373dec97-kube-api-access-wrjn4\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.425606 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a89f4c0d-6b46-481c-9481-15a0373dec97-console-oauth-config\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.425606 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a89f4c0d-6b46-481c-9481-15a0373dec97-console-serving-cert\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.425606 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-service-ca\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.425606 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-trusted-ca-bundle\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.425751 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.425614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-oauth-serving-cert\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.428343 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.428310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:54.491725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.491687 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:11:54.526270 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-trusted-ca-bundle\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.526447 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-oauth-serving-cert\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.526447 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-console-config\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.526548 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjn4\" (UniqueName: \"kubernetes.io/projected/a89f4c0d-6b46-481c-9481-15a0373dec97-kube-api-access-wrjn4\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.526548 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a89f4c0d-6b46-481c-9481-15a0373dec97-console-oauth-config\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.526548 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a89f4c0d-6b46-481c-9481-15a0373dec97-console-serving-cert\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.526692 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.526576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-service-ca\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.527094 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.527067 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-oauth-serving-cert\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.527247 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.527216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-console-config\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.527318 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.527288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-service-ca\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.527378 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.527288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a89f4c0d-6b46-481c-9481-15a0373dec97-trusted-ca-bundle\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.529326 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.529300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a89f4c0d-6b46-481c-9481-15a0373dec97-console-serving-cert\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.529419 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.529300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a89f4c0d-6b46-481c-9481-15a0373dec97-console-oauth-config\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.535586 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.535564 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjn4\" (UniqueName: \"kubernetes.io/projected/a89f4c0d-6b46-481c-9481-15a0373dec97-kube-api-access-wrjn4\") pod \"console-6bdfcddf45-rpsv4\" (UID: \"a89f4c0d-6b46-481c-9481-15a0373dec97\") " pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.677273 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.677229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:11:54.811056 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:54.811002 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bdfcddf45-rpsv4"] Jul 09 18:11:54.813857 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:11:54.813830 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89f4c0d_6b46_481c_9481_15a0373dec97.slice/crio-3d4a391c2a4894653a7dcb2c21ff99f013929e4e160343a4f81174ba89002d9b WatchSource:0}: Error finding container 3d4a391c2a4894653a7dcb2c21ff99f013929e4e160343a4f81174ba89002d9b: Status 404 returned error can't find the container with id 3d4a391c2a4894653a7dcb2c21ff99f013929e4e160343a4f81174ba89002d9b Jul 09 18:11:55.079360 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:55.079273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bdfcddf45-rpsv4" event={"ID":"a89f4c0d-6b46-481c-9481-15a0373dec97","Type":"ContainerStarted","Data":"88e86ed51ff57332415e08e146b6d07dea24200f7a3884354e47afe1fbe26fb7"} Jul 09 18:11:55.079360 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:55.079322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bdfcddf45-rpsv4" event={"ID":"a89f4c0d-6b46-481c-9481-15a0373dec97","Type":"ContainerStarted","Data":"3d4a391c2a4894653a7dcb2c21ff99f013929e4e160343a4f81174ba89002d9b"} Jul 09 18:11:55.102409 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:11:55.102353 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bdfcddf45-rpsv4" podStartSLOduration=1.102336481 podStartE2EDuration="1.102336481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:55.099886293 +0000 UTC m=+496.557702827" watchObservedRunningTime="2026-07-09 18:11:55.102336481 +0000 UTC m=+496.560153014" Jul 09 18:12:04.677910 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:04.677879 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:12:04.678326 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:04.678188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:12:04.683013 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:04.682980 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:12:05.124105 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:05.124014 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bdfcddf45-rpsv4" Jul 09 18:12:05.181246 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:05.181210 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5644488cff-lv2l2"] Jul 09 18:12:06.335242 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:06.335207 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:06.404793 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:06.404754 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:19.765786 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.765747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:19.839648 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.839613 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-rscg9"] Jul 09 18:12:19.841923 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.841906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:19.846543 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.846525 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-xfdgw\"" Jul 09 18:12:19.847692 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.847514 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 09 18:12:19.847692 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.847589 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 09 18:12:19.847988 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.847971 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 09 18:12:19.849519 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.849500 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-kp7m2"] Jul 09 18:12:19.851604 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.851584 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:19.852064 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.851997 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:19.854117 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.854096 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 09 18:12:19.854214 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.854131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-72jvh\"" Jul 09 18:12:19.860338 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.860319 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-rscg9"] Jul 09 18:12:19.862523 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.862501 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-kp7m2"] Jul 09 18:12:19.942362 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.942330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc810e4-b3a2-4c48-a090-58f868627e06-cert\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:19.942536 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.942370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784eba33-6eab-49ac-be41-2d4b3f1086e2-cert\") pod \"kserve-controller-manager-748bdf6488-rscg9\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:19.942536 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.942394 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jw5r\" (UniqueName: \"kubernetes.io/projected/784eba33-6eab-49ac-be41-2d4b3f1086e2-kube-api-access-5jw5r\") pod \"kserve-controller-manager-748bdf6488-rscg9\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:19.942536 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.942487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9hdj\" (UniqueName: \"kubernetes.io/projected/efc810e4-b3a2-4c48-a090-58f868627e06-kube-api-access-l9hdj\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:19.968267 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:19.968221 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:20.043247 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.043163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc810e4-b3a2-4c48-a090-58f868627e06-cert\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:20.043247 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.043204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784eba33-6eab-49ac-be41-2d4b3f1086e2-cert\") pod \"kserve-controller-manager-748bdf6488-rscg9\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:20.043247 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.043229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jw5r\" (UniqueName: \"kubernetes.io/projected/784eba33-6eab-49ac-be41-2d4b3f1086e2-kube-api-access-5jw5r\") pod \"kserve-controller-manager-748bdf6488-rscg9\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:20.043509 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.043261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9hdj\" (UniqueName: \"kubernetes.io/projected/efc810e4-b3a2-4c48-a090-58f868627e06-kube-api-access-l9hdj\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:20.043509 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:12:20.043340 2564 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 09 18:12:20.043509 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:12:20.043412 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc810e4-b3a2-4c48-a090-58f868627e06-cert podName:efc810e4-b3a2-4c48-a090-58f868627e06 nodeName:}" failed. No retries permitted until 2026-07-09 18:12:20.543397143 +0000 UTC m=+522.001213653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/efc810e4-b3a2-4c48-a090-58f868627e06-cert") pod "llmisvc-controller-manager-654c557856-kp7m2" (UID: "efc810e4-b3a2-4c48-a090-58f868627e06") : secret "llmisvc-webhook-server-cert" not found Jul 09 18:12:20.045780 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.045752 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784eba33-6eab-49ac-be41-2d4b3f1086e2-cert\") pod \"kserve-controller-manager-748bdf6488-rscg9\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:20.052938 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.052906 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9hdj\" (UniqueName: \"kubernetes.io/projected/efc810e4-b3a2-4c48-a090-58f868627e06-kube-api-access-l9hdj\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:20.053444 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.053422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jw5r\" (UniqueName: \"kubernetes.io/projected/784eba33-6eab-49ac-be41-2d4b3f1086e2-kube-api-access-5jw5r\") pod \"kserve-controller-manager-748bdf6488-rscg9\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:20.069668 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.069641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:20.153136 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.153091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:20.223380 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.223346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:20.286243 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.286209 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-rscg9"] Jul 09 18:12:20.290207 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:12:20.290184 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784eba33_6eab_49ac_be41_2d4b3f1086e2.slice/crio-20f92eb9dc3a7a962fae81da14c7c3888e175cf7d5e0ab5fe9edb0a2d2207fe1 WatchSource:0}: Error finding container 20f92eb9dc3a7a962fae81da14c7c3888e175cf7d5e0ab5fe9edb0a2d2207fe1: Status 404 returned error can't find the container with id 20f92eb9dc3a7a962fae81da14c7c3888e175cf7d5e0ab5fe9edb0a2d2207fe1 Jul 09 18:12:20.380000 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.379962 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:20.483222 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.483187 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:20.547554 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.547470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc810e4-b3a2-4c48-a090-58f868627e06-cert\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:20.550013 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.549995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/efc810e4-b3a2-4c48-a090-58f868627e06-cert\") pod \"llmisvc-controller-manager-654c557856-kp7m2\" (UID: \"efc810e4-b3a2-4c48-a090-58f868627e06\") " pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:20.582415 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.582379 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:20.761180 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.761138 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:20.912837 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:20.912626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-kp7m2"] Jul 09 18:12:20.916460 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:12:20.916423 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podefc810e4_b3a2_4c48_a090_58f868627e06.slice/crio-42f21d0e701725dfd61cf8a9933356f2d2c8fc681bcbb85e130ad5e279f47d49 WatchSource:0}: Error finding container 42f21d0e701725dfd61cf8a9933356f2d2c8fc681bcbb85e130ad5e279f47d49: Status 404 returned error can't find the container with id 42f21d0e701725dfd61cf8a9933356f2d2c8fc681bcbb85e130ad5e279f47d49 Jul 09 18:12:21.190118 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:21.190018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" event={"ID":"784eba33-6eab-49ac-be41-2d4b3f1086e2","Type":"ContainerStarted","Data":"20f92eb9dc3a7a962fae81da14c7c3888e175cf7d5e0ab5fe9edb0a2d2207fe1"} Jul 09 18:12:21.191481 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:21.191449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" event={"ID":"efc810e4-b3a2-4c48-a090-58f868627e06","Type":"ContainerStarted","Data":"42f21d0e701725dfd61cf8a9933356f2d2c8fc681bcbb85e130ad5e279f47d49"} Jul 09 18:12:24.209451 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:24.209413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" event={"ID":"784eba33-6eab-49ac-be41-2d4b3f1086e2","Type":"ContainerStarted","Data":"db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2"} Jul 09 18:12:24.209888 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:24.209566 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:24.238176 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:24.238117 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" podStartSLOduration=2.400359214 podStartE2EDuration="5.238100656s" totalImagesPullingTime="2.837741442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:24.236129889 +0000 UTC m=+525.693946428" watchObservedRunningTime="2026-07-09 18:12:24.238100656 +0000 UTC m=+525.695917189" Jul 09 18:12:26.219903 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:26.219865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" event={"ID":"efc810e4-b3a2-4c48-a090-58f868627e06","Type":"ContainerStarted","Data":"b42a9b6f80ffd275bfbabf714d30141c57e50ed15a39b38ba6b9faab57532d0d"} Jul 09 18:12:26.220323 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:26.219980 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:26.238491 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:26.238444 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" podStartSLOduration=2.831431597 podStartE2EDuration="7.23843013s" totalImagesPullingTime="4.406998533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:26.237572903 +0000 UTC m=+527.695389434" watchObservedRunningTime="2026-07-09 18:12:26.23843013 +0000 UTC m=+527.696246661" Jul 09 18:12:30.202295 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.202207 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5644488cff-lv2l2" podUID="5daf1821-eb75-4df5-a561-3804452e74d9" containerName="console" containerID="cri-o://0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996" gracePeriod=15 Jul 09 18:12:30.451116 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.451095 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:12:30.633518 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633423 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-service-ca\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633518 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633510 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-oauth-serving-cert\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633742 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633539 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-oauth-config\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633742 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633561 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp7bg\" (UniqueName: \"kubernetes.io/projected/5daf1821-eb75-4df5-a561-3804452e74d9-kube-api-access-tp7bg\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633742 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633595 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-trusted-ca-bundle\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633742 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633625 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-console-config\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633742 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633654 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-serving-cert\") pod \"5daf1821-eb75-4df5-a561-3804452e74d9\" (UID: \"5daf1821-eb75-4df5-a561-3804452e74d9\") " Jul 09 18:12:30.633989 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633841 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:12:30.634100 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.633950 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:12:30.634160 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.634126 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-console-config" (OuterVolumeSpecName: "console-config") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:12:30.634160 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.634150 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:12:30.635917 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.635887 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:12:30.635917 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.635888 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5daf1821-eb75-4df5-a561-3804452e74d9-kube-api-access-tp7bg" (OuterVolumeSpecName: "kube-api-access-tp7bg") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "kube-api-access-tp7bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:12:30.636086 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.635911 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5daf1821-eb75-4df5-a561-3804452e74d9" (UID: "5daf1821-eb75-4df5-a561-3804452e74d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:12:30.734479 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734441 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-oauth-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:30.734479 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734472 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-oauth-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:30.734479 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734481 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp7bg\" (UniqueName: \"kubernetes.io/projected/5daf1821-eb75-4df5-a561-3804452e74d9-kube-api-access-tp7bg\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:30.734725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734491 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-trusted-ca-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:30.734725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734501 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-console-config\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:30.734725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734509 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf1821-eb75-4df5-a561-3804452e74d9-console-serving-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:30.734725 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:30.734518 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf1821-eb75-4df5-a561-3804452e74d9-service-ca\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:31.242011 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.241968 2564 generic.go:356] "Generic (PLEG): container finished" podID="5daf1821-eb75-4df5-a561-3804452e74d9" containerID="0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996" exitCode=0 Jul 09 18:12:31.242435 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.242060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644488cff-lv2l2" event={"ID":"5daf1821-eb75-4df5-a561-3804452e74d9","Type":"ContainerDied","Data":"0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996"} Jul 09 18:12:31.242435 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.242070 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5644488cff-lv2l2" Jul 09 18:12:31.242435 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.242113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5644488cff-lv2l2" event={"ID":"5daf1821-eb75-4df5-a561-3804452e74d9","Type":"ContainerDied","Data":"a96b1f7c56cf327a6b3099c9f99cfaf9c29fc76fa471650c4b021c317850d29d"} Jul 09 18:12:31.242435 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.242139 2564 scope.go:117] "RemoveContainer" containerID="0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996" Jul 09 18:12:31.250550 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.250533 2564 scope.go:117] "RemoveContainer" containerID="0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996" Jul 09 18:12:31.250820 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:12:31.250801 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996\": container with ID starting with 0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996 not found: ID does not exist" containerID="0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996" Jul 09 18:12:31.250886 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.250834 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996"} err="failed to get container status \"0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996\": rpc error: code = NotFound desc = could not find container \"0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996\": container with ID starting with 0e416dfd757519961dece5a355f5bee267e830d38022146851288b2f302f5996 not found: ID does not exist" Jul 09 18:12:31.259501 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.259478 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5644488cff-lv2l2"] Jul 09 18:12:31.262836 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:31.262817 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5644488cff-lv2l2"] Jul 09 18:12:33.061408 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:33.061375 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5daf1821-eb75-4df5-a561-3804452e74d9" path="/var/lib/kubelet/pods/5daf1821-eb75-4df5-a561-3804452e74d9/volumes" Jul 09 18:12:50.966268 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:50.966227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:51.464197 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:51.464156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:12:55.219663 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:55.219632 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:57.226098 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:57.226067 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-kp7m2" Jul 09 18:12:58.518919 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.518879 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-rscg9"] Jul 09 18:12:58.519363 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.519098 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" podUID="784eba33-6eab-49ac-be41-2d4b3f1086e2" containerName="manager" containerID="cri-o://db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2" gracePeriod=10 Jul 09 18:12:58.568129 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.568094 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-c7wd8"] Jul 09 18:12:58.568427 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.568414 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5daf1821-eb75-4df5-a561-3804452e74d9" containerName="console" Jul 09 18:12:58.568472 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.568429 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5daf1821-eb75-4df5-a561-3804452e74d9" containerName="console" Jul 09 18:12:58.568506 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.568499 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5daf1821-eb75-4df5-a561-3804452e74d9" containerName="console" Jul 09 18:12:58.570368 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.570351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.626283 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.626248 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-c7wd8"] Jul 09 18:12:58.643427 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.643390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af54eb50-a386-46af-95d1-46f298348e48-cert\") pod \"kserve-controller-manager-748bdf6488-c7wd8\" (UID: \"af54eb50-a386-46af-95d1-46f298348e48\") " pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.643427 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.643427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbz9\" (UniqueName: \"kubernetes.io/projected/af54eb50-a386-46af-95d1-46f298348e48-kube-api-access-wvbz9\") pod \"kserve-controller-manager-748bdf6488-c7wd8\" (UID: \"af54eb50-a386-46af-95d1-46f298348e48\") " pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.743944 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.743921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af54eb50-a386-46af-95d1-46f298348e48-cert\") pod \"kserve-controller-manager-748bdf6488-c7wd8\" (UID: \"af54eb50-a386-46af-95d1-46f298348e48\") " pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.744088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.743955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbz9\" (UniqueName: \"kubernetes.io/projected/af54eb50-a386-46af-95d1-46f298348e48-kube-api-access-wvbz9\") pod \"kserve-controller-manager-748bdf6488-c7wd8\" (UID: \"af54eb50-a386-46af-95d1-46f298348e48\") " pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.746479 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.746456 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af54eb50-a386-46af-95d1-46f298348e48-cert\") pod \"kserve-controller-manager-748bdf6488-c7wd8\" (UID: \"af54eb50-a386-46af-95d1-46f298348e48\") " pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.752697 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.752676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbz9\" (UniqueName: \"kubernetes.io/projected/af54eb50-a386-46af-95d1-46f298348e48-kube-api-access-wvbz9\") pod \"kserve-controller-manager-748bdf6488-c7wd8\" (UID: \"af54eb50-a386-46af-95d1-46f298348e48\") " pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.766712 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.766694 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:58.844871 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.844789 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784eba33-6eab-49ac-be41-2d4b3f1086e2-cert\") pod \"784eba33-6eab-49ac-be41-2d4b3f1086e2\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " Jul 09 18:12:58.844871 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.844842 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jw5r\" (UniqueName: \"kubernetes.io/projected/784eba33-6eab-49ac-be41-2d4b3f1086e2-kube-api-access-5jw5r\") pod \"784eba33-6eab-49ac-be41-2d4b3f1086e2\" (UID: \"784eba33-6eab-49ac-be41-2d4b3f1086e2\") " Jul 09 18:12:58.847111 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.847084 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784eba33-6eab-49ac-be41-2d4b3f1086e2-cert" (OuterVolumeSpecName: "cert") pod "784eba33-6eab-49ac-be41-2d4b3f1086e2" (UID: "784eba33-6eab-49ac-be41-2d4b3f1086e2"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 18:12:58.847203 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.847128 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784eba33-6eab-49ac-be41-2d4b3f1086e2-kube-api-access-5jw5r" (OuterVolumeSpecName: "kube-api-access-5jw5r") pod "784eba33-6eab-49ac-be41-2d4b3f1086e2" (UID: "784eba33-6eab-49ac-be41-2d4b3f1086e2"). InnerVolumeSpecName "kube-api-access-5jw5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:12:58.903454 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.903417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:12:58.945908 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.945859 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jw5r\" (UniqueName: \"kubernetes.io/projected/784eba33-6eab-49ac-be41-2d4b3f1086e2-kube-api-access-5jw5r\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:58.945908 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:58.945900 2564 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784eba33-6eab-49ac-be41-2d4b3f1086e2-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:12:59.031884 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.031862 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-c7wd8"] Jul 09 18:12:59.034264 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:12:59.034237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf54eb50_a386_46af_95d1_46f298348e48.slice/crio-aaaf50045840f96f61d0deafb6810899d5b372c9177131a5ac8d3156d315a559 WatchSource:0}: Error finding container aaaf50045840f96f61d0deafb6810899d5b372c9177131a5ac8d3156d315a559: Status 404 returned error can't find the container with id aaaf50045840f96f61d0deafb6810899d5b372c9177131a5ac8d3156d315a559 Jul 09 18:12:59.360442 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.360402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" event={"ID":"af54eb50-a386-46af-95d1-46f298348e48","Type":"ContainerStarted","Data":"aaaf50045840f96f61d0deafb6810899d5b372c9177131a5ac8d3156d315a559"} Jul 09 18:12:59.361589 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.361558 2564 generic.go:356] "Generic (PLEG): container finished" podID="784eba33-6eab-49ac-be41-2d4b3f1086e2" containerID="db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2" exitCode=0 Jul 09 18:12:59.361705 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.361619 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" Jul 09 18:12:59.361705 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.361642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" event={"ID":"784eba33-6eab-49ac-be41-2d4b3f1086e2","Type":"ContainerDied","Data":"db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2"} Jul 09 18:12:59.361705 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.361692 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-748bdf6488-rscg9" event={"ID":"784eba33-6eab-49ac-be41-2d4b3f1086e2","Type":"ContainerDied","Data":"20f92eb9dc3a7a962fae81da14c7c3888e175cf7d5e0ab5fe9edb0a2d2207fe1"} Jul 09 18:12:59.361805 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.361715 2564 scope.go:117] "RemoveContainer" containerID="db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2" Jul 09 18:12:59.369749 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.369733 2564 scope.go:117] "RemoveContainer" containerID="db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2" Jul 09 18:12:59.370048 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:12:59.370001 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2\": container with ID starting with db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2 not found: ID does not exist" containerID="db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2" Jul 09 18:12:59.370088 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.370056 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2"} err="failed to get container status \"db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2\": rpc error: code = NotFound desc = could not find container \"db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2\": container with ID starting with db49ebfa477cf97778f7ac47fec2b95f1f4eb3aa233ac937f8cdc9a0f2143fb2 not found: ID does not exist" Jul 09 18:12:59.389926 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.389897 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-rscg9"] Jul 09 18:12:59.392975 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:12:59.392952 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-748bdf6488-rscg9"] Jul 09 18:13:00.368461 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:00.368426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" event={"ID":"af54eb50-a386-46af-95d1-46f298348e48","Type":"ContainerStarted","Data":"fa55e664d0bd0ef966e2df9d95931fa2d0628dcaccc21a209e477bb42cb0758c"} Jul 09 18:13:00.368853 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:00.368559 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:13:01.062268 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:01.062236 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="784eba33-6eab-49ac-be41-2d4b3f1086e2" path="/var/lib/kubelet/pods/784eba33-6eab-49ac-be41-2d4b3f1086e2/volumes" Jul 09 18:13:31.377957 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:31.377922 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" Jul 09 18:13:31.414494 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:31.414433 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-748bdf6488-c7wd8" podStartSLOduration=32.995358823 podStartE2EDuration="33.414418353s" totalImagesPullingTime="419.05953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:00.408307023 +0000 UTC m=+561.866123553" watchObservedRunningTime="2026-07-09 18:13:31.414418353 +0000 UTC m=+592.872234885" Jul 09 18:13:32.340593 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.340543 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:13:32.372179 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.372147 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-vf65s"] Jul 09 18:13:32.372458 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.372446 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784eba33-6eab-49ac-be41-2d4b3f1086e2" containerName="manager" Jul 09 18:13:32.372506 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.372460 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="784eba33-6eab-49ac-be41-2d4b3f1086e2" containerName="manager" Jul 09 18:13:32.372541 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.372510 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="784eba33-6eab-49ac-be41-2d4b3f1086e2" containerName="manager" Jul 09 18:13:32.374231 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.374214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.377047 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.377009 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 09 18:13:32.377488 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.377464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-d62h7\"" Jul 09 18:13:32.385210 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.385185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-vf65s"] Jul 09 18:13:32.437166 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.437129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:13:32.529452 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.529422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmmvw\" (UniqueName: \"kubernetes.io/projected/9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6-kube-api-access-wmmvw\") pod \"model-serving-api-fd65d7d6-vf65s\" (UID: \"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6\") " pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.529614 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.529461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6-tls-certs\") pod \"model-serving-api-fd65d7d6-vf65s\" (UID: \"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6\") " pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.537672 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.537641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:13:32.630794 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.630708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmvw\" (UniqueName: \"kubernetes.io/projected/9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6-kube-api-access-wmmvw\") pod \"model-serving-api-fd65d7d6-vf65s\" (UID: \"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6\") " pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.630794 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.630747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6-tls-certs\") pod \"model-serving-api-fd65d7d6-vf65s\" (UID: \"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6\") " pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.633246 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.633223 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6-tls-certs\") pod \"model-serving-api-fd65d7d6-vf65s\" (UID: \"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6\") " pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.645129 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.645106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmmvw\" (UniqueName: \"kubernetes.io/projected/9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6-kube-api-access-wmmvw\") pod \"model-serving-api-fd65d7d6-vf65s\" (UID: \"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6\") " pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.654358 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.654334 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:13:32.686105 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.686078 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:32.820663 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:32.820624 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-vf65s"] Jul 09 18:13:32.823538 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:13:32.823508 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4340ed_e634_4bc3_91b5_0c4e5fbe9de6.slice/crio-2301a633973e0e29028d4c6d77a3b4af5be825319f51f066236ff4186734d050 WatchSource:0}: Error finding container 2301a633973e0e29028d4c6d77a3b4af5be825319f51f066236ff4186734d050: Status 404 returned error can't find the container with id 2301a633973e0e29028d4c6d77a3b4af5be825319f51f066236ff4186734d050 Jul 09 18:13:33.187126 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:33.187084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:13:33.256873 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:33.256837 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:13:33.507912 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:33.507828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-vf65s" event={"ID":"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6","Type":"ContainerStarted","Data":"2301a633973e0e29028d4c6d77a3b4af5be825319f51f066236ff4186734d050"} Jul 09 18:13:35.518381 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:35.518346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-vf65s" event={"ID":"9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6","Type":"ContainerStarted","Data":"7ae3bf66ff2e11c6c5d695c645c57cc494a5ae420bc0a0e65f50852417135e26"} Jul 09 18:13:35.518790 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:35.518475 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:13:35.537850 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:35.537803 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-vf65s" podStartSLOduration=1.6262418250000001 podStartE2EDuration="3.537788414s" totalImagesPullingTime="1.911546589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:35.536841592 +0000 UTC m=+596.994658126" watchObservedRunningTime="2026-07-09 18:13:35.537788414 +0000 UTC m=+596.995605006" Jul 09 18:13:38.959266 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:38.959233 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:13:38.962266 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:38.962243 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:13:38.968402 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:38.968384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:13:38.971146 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:38.971130 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:13:46.527352 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:13:46.527323 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-vf65s" Jul 09 18:15:00.652070 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:00.652019 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:07.500164 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.500129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:07.503502 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.503477 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9"] Jul 09 18:15:07.505718 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.505702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.508278 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.508259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 09 18:15:07.508377 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.508259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mdfvk\"" Jul 09 18:15:07.515060 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.515024 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9"] Jul 09 18:15:07.568154 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.568114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt7cs\" (UniqueName: \"kubernetes.io/projected/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-kube-api-access-dt7cs\") pod \"seaweedfs-tls-custom-6644bf5d6c-bsvr9\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.568330 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.568169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-bsvr9\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.669347 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.669303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt7cs\" (UniqueName: \"kubernetes.io/projected/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-kube-api-access-dt7cs\") pod \"seaweedfs-tls-custom-6644bf5d6c-bsvr9\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.669530 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.669362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-bsvr9\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.669734 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.669716 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-bsvr9\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.678942 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.678910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt7cs\" (UniqueName: \"kubernetes.io/projected/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-kube-api-access-dt7cs\") pod \"seaweedfs-tls-custom-6644bf5d6c-bsvr9\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.815438 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.815337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:07.952953 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:07.952920 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9"] Jul 09 18:15:07.956211 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:15:07.956179 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57eb3245_bc2c_45bf_b940_ecbd586c4fc2.slice/crio-6e69ee4c069f408cb5c8b2f069f7701fdce5a0f915416350332147208d4b681b WatchSource:0}: Error finding container 6e69ee4c069f408cb5c8b2f069f7701fdce5a0f915416350332147208d4b681b: Status 404 returned error can't find the container with id 6e69ee4c069f408cb5c8b2f069f7701fdce5a0f915416350332147208d4b681b Jul 09 18:15:08.913894 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:08.913853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" event={"ID":"57eb3245-bc2c-45bf-b940-ecbd586c4fc2","Type":"ContainerStarted","Data":"6e69ee4c069f408cb5c8b2f069f7701fdce5a0f915416350332147208d4b681b"} Jul 09 18:15:13.936077 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:13.936015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" event={"ID":"57eb3245-bc2c-45bf-b940-ecbd586c4fc2","Type":"ContainerStarted","Data":"d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05"} Jul 09 18:15:13.953241 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:13.953195 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" podStartSLOduration=2.028035538 podStartE2EDuration="6.95318102s" totalImagesPullingTime="4.925145482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:15:13.951482859 +0000 UTC m=+695.409299382" watchObservedRunningTime="2026-07-09 18:15:13.95318102 +0000 UTC m=+695.410997552" Jul 09 18:15:15.005981 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:15.005941 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9"] Jul 09 18:15:15.944279 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:15.944216 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" podUID="57eb3245-bc2c-45bf-b940-ecbd586c4fc2" containerName="seaweedfs-tls-custom" containerID="cri-o://d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05" gracePeriod=30 Jul 09 18:15:17.188643 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.188618 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:17.241600 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.241518 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt7cs\" (UniqueName: \"kubernetes.io/projected/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-kube-api-access-dt7cs\") pod \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " Jul 09 18:15:17.241743 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.241627 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-data\") pod \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\" (UID: \"57eb3245-bc2c-45bf-b940-ecbd586c4fc2\") " Jul 09 18:15:17.243358 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.243325 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-data" (OuterVolumeSpecName: "data") pod "57eb3245-bc2c-45bf-b940-ecbd586c4fc2" (UID: "57eb3245-bc2c-45bf-b940-ecbd586c4fc2"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:17.243699 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.243682 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-kube-api-access-dt7cs" (OuterVolumeSpecName: "kube-api-access-dt7cs") pod "57eb3245-bc2c-45bf-b940-ecbd586c4fc2" (UID: "57eb3245-bc2c-45bf-b940-ecbd586c4fc2"). InnerVolumeSpecName "kube-api-access-dt7cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:15:17.342262 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.342227 2564 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-data\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:15:17.342262 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.342254 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt7cs\" (UniqueName: \"kubernetes.io/projected/57eb3245-bc2c-45bf-b940-ecbd586c4fc2-kube-api-access-dt7cs\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Jul 09 18:15:17.955597 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.955560 2564 generic.go:356] "Generic (PLEG): container finished" podID="57eb3245-bc2c-45bf-b940-ecbd586c4fc2" containerID="d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05" exitCode=0 Jul 09 18:15:17.955778 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.955606 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" Jul 09 18:15:17.955778 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.955646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" event={"ID":"57eb3245-bc2c-45bf-b940-ecbd586c4fc2","Type":"ContainerDied","Data":"d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05"} Jul 09 18:15:17.955778 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.955699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9" event={"ID":"57eb3245-bc2c-45bf-b940-ecbd586c4fc2","Type":"ContainerDied","Data":"6e69ee4c069f408cb5c8b2f069f7701fdce5a0f915416350332147208d4b681b"} Jul 09 18:15:17.955778 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.955720 2564 scope.go:117] "RemoveContainer" containerID="d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05" Jul 09 18:15:17.965615 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.965601 2564 scope.go:117] "RemoveContainer" containerID="d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05" Jul 09 18:15:17.965861 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:15:17.965845 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05\": container with ID starting with d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05 not found: ID does not exist" containerID="d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05" Jul 09 18:15:17.965901 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.965872 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05"} err="failed to get container status \"d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05\": rpc error: code = NotFound desc = could not find container \"d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05\": container with ID starting with d51fbf00bf448d6902166175c9e39cacd6225be2857f9704a63582b9383feb05 not found: ID does not exist" Jul 09 18:15:17.977338 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.977314 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9"] Jul 09 18:15:17.982096 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:17.982068 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-bsvr9"] Jul 09 18:15:18.021705 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.021675 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-pd7pk"] Jul 09 18:15:18.022005 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.021993 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57eb3245-bc2c-45bf-b940-ecbd586c4fc2" containerName="seaweedfs-tls-custom" Jul 09 18:15:18.022069 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.022006 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="57eb3245-bc2c-45bf-b940-ecbd586c4fc2" containerName="seaweedfs-tls-custom" Jul 09 18:15:18.022101 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.022080 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="57eb3245-bc2c-45bf-b940-ecbd586c4fc2" containerName="seaweedfs-tls-custom" Jul 09 18:15:18.024706 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.024688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.027600 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.027571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 09 18:15:18.027716 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.027660 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 09 18:15:18.027716 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.027668 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mdfvk\"" Jul 09 18:15:18.032894 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.032871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-pd7pk"] Jul 09 18:15:18.148932 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.148899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9lx\" (UniqueName: \"kubernetes.io/projected/4b149659-9030-48e9-a213-1c8de5e5aceb-kube-api-access-rs9lx\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.149140 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.148950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/4b149659-9030-48e9-a213-1c8de5e5aceb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.149140 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.148971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b149659-9030-48e9-a213-1c8de5e5aceb-data\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.249440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.249367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/4b149659-9030-48e9-a213-1c8de5e5aceb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.249440 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.249403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b149659-9030-48e9-a213-1c8de5e5aceb-data\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.249807 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.249479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9lx\" (UniqueName: \"kubernetes.io/projected/4b149659-9030-48e9-a213-1c8de5e5aceb-kube-api-access-rs9lx\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.249886 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.249864 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b149659-9030-48e9-a213-1c8de5e5aceb-data\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.251954 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.251936 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/4b149659-9030-48e9-a213-1c8de5e5aceb-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.259625 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.259600 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9lx\" (UniqueName: \"kubernetes.io/projected/4b149659-9030-48e9-a213-1c8de5e5aceb-kube-api-access-rs9lx\") pod \"seaweedfs-tls-custom-8b44d767d-pd7pk\" (UID: \"4b149659-9030-48e9-a213-1c8de5e5aceb\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.334542 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.334512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" Jul 09 18:15:18.464313 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.464170 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-pd7pk"] Jul 09 18:15:18.466996 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:15:18.466962 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b149659_9030_48e9_a213_1c8de5e5aceb.slice/crio-cc84e71cb709ef98d3f5c2ed374bbba63d6b5ba644af96c64042397f026b3129 WatchSource:0}: Error finding container cc84e71cb709ef98d3f5c2ed374bbba63d6b5ba644af96c64042397f026b3129: Status 404 returned error can't find the container with id cc84e71cb709ef98d3f5c2ed374bbba63d6b5ba644af96c64042397f026b3129 Jul 09 18:15:18.961094 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.961057 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" event={"ID":"4b149659-9030-48e9-a213-1c8de5e5aceb","Type":"ContainerStarted","Data":"c388ad900aa00654797afb98dd325609e6840c71b5a2640857d0bb372e167d8a"} Jul 09 18:15:18.961286 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.961116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" event={"ID":"4b149659-9030-48e9-a213-1c8de5e5aceb","Type":"ContainerStarted","Data":"cc84e71cb709ef98d3f5c2ed374bbba63d6b5ba644af96c64042397f026b3129"} Jul 09 18:15:18.978233 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:18.978184 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-pd7pk" podStartSLOduration=1.6478593959999999 podStartE2EDuration="1.978169311s" totalImagesPullingTime="330.309915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:15:18.976747367 +0000 UTC m=+700.434563901" watchObservedRunningTime="2026-07-09 18:15:18.978169311 +0000 UTC m=+700.435985842" Jul 09 18:15:19.062751 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:19.062668 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57eb3245-bc2c-45bf-b940-ecbd586c4fc2" path="/var/lib/kubelet/pods/57eb3245-bc2c-45bf-b940-ecbd586c4fc2/volumes" Jul 09 18:15:30.451706 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.451606 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:30.454561 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.454533 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj"] Jul 09 18:15:30.457499 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.457479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.461509 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.460357 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 09 18:15:30.461509 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.460640 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 09 18:15:30.468472 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.468452 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj"] Jul 09 18:15:30.548977 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.548938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.549177 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.548994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2cf\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-kube-api-access-4p2cf\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.549177 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.549019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/369f0124-8e37-41b6-8082-4113f564757f-data\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.650424 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.650387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2cf\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-kube-api-access-4p2cf\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.650424 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.650425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/369f0124-8e37-41b6-8082-4113f564757f-data\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.650660 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.650510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.650660 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:15:30.650606 2564 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 09 18:15:30.650660 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:15:30.650621 2564 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj: secret "seaweedfs-tls-serving" not found Jul 09 18:15:30.650811 ip-10-0-143-68 kubenswrapper[2564]: E0709 18:15:30.650672 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-seaweedfs-tls-serving podName:369f0124-8e37-41b6-8082-4113f564757f nodeName:}" failed. No retries permitted until 2026-07-09 18:15:31.150653207 +0000 UTC m=+712.608469719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-2f8gj" (UID: "369f0124-8e37-41b6-8082-4113f564757f") : secret "seaweedfs-tls-serving" not found Jul 09 18:15:30.650955 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.650930 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/369f0124-8e37-41b6-8082-4113f564757f-data\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.659317 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.659296 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2cf\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-kube-api-access-4p2cf\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:30.757181 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:30.757101 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:31.155827 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:31.155739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:31.158266 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:31.158244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/369f0124-8e37-41b6-8082-4113f564757f-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-2f8gj\" (UID: \"369f0124-8e37-41b6-8082-4113f564757f\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:31.370664 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:31.370631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" Jul 09 18:15:31.510795 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:31.510759 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj"] Jul 09 18:15:31.513846 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:15:31.513812 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369f0124_8e37_41b6_8082_4113f564757f.slice/crio-f767c60b932466ed7c2a69a73db8b426d2578a412737520447ce406474b464e1 WatchSource:0}: Error finding container f767c60b932466ed7c2a69a73db8b426d2578a412737520447ce406474b464e1: Status 404 returned error can't find the container with id f767c60b932466ed7c2a69a73db8b426d2578a412737520447ce406474b464e1 Jul 09 18:15:32.026625 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:32.026525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" event={"ID":"369f0124-8e37-41b6-8082-4113f564757f","Type":"ContainerStarted","Data":"8d942d0b44fd6a3d32772249dee6141b6aa4da16cd735c7bd897189d146d55fb"} Jul 09 18:15:32.026625 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:32.026574 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" event={"ID":"369f0124-8e37-41b6-8082-4113f564757f","Type":"ContainerStarted","Data":"f767c60b932466ed7c2a69a73db8b426d2578a412737520447ce406474b464e1"} Jul 09 18:15:32.044896 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:32.044847 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-2f8gj" podStartSLOduration=1.78891563 podStartE2EDuration="2.044831912s" totalImagesPullingTime="255.916282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:15:32.043978168 +0000 UTC m=+713.501794700" watchObservedRunningTime="2026-07-09 18:15:32.044831912 +0000 UTC m=+713.502648444" Jul 09 18:15:45.329704 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:45.329667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:45.430989 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:45.430957 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:53.171668 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:53.171636 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:54.234882 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:54.234850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:56.584221 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:56.584182 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:15:57.322084 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:15:57.322049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:16:42.652724 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:16:42.652681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:16:42.711448 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:16:42.711409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:17:41.857296 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:17:41.857256 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:17:41.951586 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:17:41.951545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:17:42.176535 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:17:42.176502 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:18:38.985905 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:18:38.985828 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:18:38.988974 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:18:38.988956 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:18:38.992299 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:18:38.992279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:18:38.995756 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:18:38.995737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:18:57.088274 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:18:57.088232 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:19:17.099678 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:19:17.099641 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:19:17.202467 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:19:17.202414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:19:17.322376 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:19:17.322341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:19:37.139957 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:19:37.139917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:19:37.360122 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:19:37.360078 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:21:12.468162 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:21:12.468123 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:21:13.732865 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:21:13.732830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:23:39.012231 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:23:39.012197 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:23:39.015230 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:23:39.015207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:23:39.017670 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:23:39.017650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:23:39.020743 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:23:39.020709 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:24:03.951091 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:24:03.951054 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:24:32.692521 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:24:32.692433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:24:37.973141 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:24:37.973084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:24:38.601376 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:24:38.601345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:26:28.590972 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:26:28.590930 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:26:33.337037 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:26:33.336979 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:26:33.759624 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:26:33.759577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:28:23.136713 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:23.136679 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:28:23.656646 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:23.656610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:28:28.804139 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:28.804103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:28:29.004993 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:29.004957 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:28:39.039232 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:39.039192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:28:39.041947 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:39.041922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:28:39.042168 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:39.042150 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:28:39.044817 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:28:39.044798 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:30:39.971566 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:30:39.971487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:30:44.034730 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:30:44.034688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:30:44.357258 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:30:44.357169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:14.236300 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:14.236266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:20.209023 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:20.208987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:20.275961 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:20.275933 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:50.301543 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:50.301498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:51.967849 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:51.967813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:53.219932 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:53.219904 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cg4q9_dfd09c09-cbca-4c33-a7ec-4d513d1c5cfa/global-pull-secret-syncer/0.log" Jul 09 18:31:53.327935 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:53.327902 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" Jul 09 18:31:53.472967 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:53.472897 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-68.ec2.internal_461a8c1189d3fa14a8ddfb5e1ff91d87/haproxy/0.log" Jul 09 18:31:56.103449 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:56.103420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:56.171591 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:56.171561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2qzt_0bc78bd7-1012-4fe6-b458-1a85a7ca5ec6/konnectivity-agent/0.log" limit=1024 Jul 09 18:31:58.089289 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:58.089256 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-bdk7m_f2fbc9b3-0689-47f0-85ae-55ea6a4c1020/cluster-monitoring-operator/0.log" Jul 09 18:31:58.363934 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:58.363858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4vbl_e2584366-0f49-400c-b577-c82bd8d3794b/node-exporter/0.log" Jul 09 18:31:58.393459 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:58.393425 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4vbl_e2584366-0f49-400c-b577-c82bd8d3794b/kube-rbac-proxy/0.log" Jul 09 18:31:58.412474 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:31:58.412451 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4vbl_e2584366-0f49-400c-b577-c82bd8d3794b/init-textfile/0.log" Jul 09 18:32:01.214953 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.214922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/2.log" Jul 09 18:32:01.219240 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.219215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4d5dr_a53b6e14-0910-41bb-be1f-fa93cf179551/console-operator/3.log" Jul 09 18:32:01.647650 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.647574 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bdfcddf45-rpsv4_a89f4c0d-6b46-481c-9481-15a0373dec97/console/0.log" Jul 09 18:32:01.678335 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.678306 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-dbh4x_22b2465d-c63c-49aa-93bb-5dd1cc5c2704/download-server/0.log" Jul 09 18:32:01.803443 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.800585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs"] Jul 09 18:32:01.805348 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.805323 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:01.808092 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.808067 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sbwk5\"/\"kube-root-ca.crt\"" Jul 09 18:32:01.808219 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.808117 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sbwk5\"/\"default-dockercfg-w7zhs\"" Jul 09 18:32:01.809087 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.809071 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sbwk5\"/\"openshift-service-ca.crt\"" Jul 09 18:32:01.812558 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.812535 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs"] Jul 09 18:32:01.909568 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.909487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-proc\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:01.909568 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.909526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-sys\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:01.909568 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.909553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-lib-modules\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:01.909827 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.909652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-podres\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:01.909827 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:01.909683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8s2r\" (UniqueName: \"kubernetes.io/projected/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-kube-api-access-g8s2r\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010560 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8s2r\" (UniqueName: \"kubernetes.io/projected/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-kube-api-access-g8s2r\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-proc\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-sys\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-lib-modules\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-podres\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010768 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010728 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-sys\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010978 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010779 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-proc\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010978 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010797 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-lib-modules\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.010978 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.010814 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-podres\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.018501 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.018478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8s2r\" (UniqueName: \"kubernetes.io/projected/d2f44da0-0579-4c3f-b65c-dbbd2660b37d-kube-api-access-g8s2r\") pod \"perf-node-gather-daemonset-pkfzs\" (UID: \"d2f44da0-0579-4c3f-b65c-dbbd2660b37d\") " pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.115952 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.115916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:02.251504 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.251476 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs"] Jul 09 18:32:02.253708 ip-10-0-143-68 kubenswrapper[2564]: W0709 18:32:02.253676 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd2f44da0_0579_4c3f_b65c_dbbd2660b37d.slice/crio-6076f2dd2d16e2d1d266884e97b8fb3c47f0e542d2b8f761ebaa88344eefed68 WatchSource:0}: Error finding container 6076f2dd2d16e2d1d266884e97b8fb3c47f0e542d2b8f761ebaa88344eefed68: Status 404 returned error can't find the container with id 6076f2dd2d16e2d1d266884e97b8fb3c47f0e542d2b8f761ebaa88344eefed68 Jul 09 18:32:02.291940 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:02.291921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-6nrmf_f3d7826c-3cde-4b9f-bbaa-7655d1fc842c/volume-data-source-validator/0.log" Jul 09 18:32:03.258123 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.258086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" event={"ID":"d2f44da0-0579-4c3f-b65c-dbbd2660b37d","Type":"ContainerStarted","Data":"bc9ec7742ab1d79f328473b11f76591b7767bb24ed9c2a7f932e56328313e45c"} Jul 09 18:32:03.258623 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.258151 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" event={"ID":"d2f44da0-0579-4c3f-b65c-dbbd2660b37d","Type":"ContainerStarted","Data":"6076f2dd2d16e2d1d266884e97b8fb3c47f0e542d2b8f761ebaa88344eefed68"} Jul 09 18:32:03.258623 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.258204 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:03.275545 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.275498 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" podStartSLOduration=2.275484627 podStartE2EDuration="2.275484627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:03.27439972 +0000 UTC m=+1704.732216265" watchObservedRunningTime="2026-07-09 18:32:03.275484627 +0000 UTC m=+1704.733301159" Jul 09 18:32:03.327793 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.327770 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phqc7_a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f/dns/0.log" Jul 09 18:32:03.355213 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.355168 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phqc7_a5d7771f-2471-4b2c-9a92-2dd9f6bd7c5f/kube-rbac-proxy/0.log" Jul 09 18:32:03.437111 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:03.437085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmbxn_745e7b74-43a1-48c1-bb51-2cfce52bbfb5/dns-node-resolver/0.log" Jul 09 18:32:04.074589 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:04.074558 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmw2x_14256da0-5916-43c0-ad56-8ce687a9191d/node-ca/0.log" Jul 09 18:32:05.377141 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:05.377111 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqzxk_f048dafc-a792-420c-bf53-c158974e1ca9/serve-healthcheck-canary/0.log" Jul 09 18:32:05.817911 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:05.817884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjwm6_58ac4df2-1383-4bda-bf96-d7c33a9b195a/kube-rbac-proxy/0.log" Jul 09 18:32:05.841636 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:05.841611 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjwm6_58ac4df2-1383-4bda-bf96-d7c33a9b195a/exporter/0.log" Jul 09 18:32:05.866369 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:05.866345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjwm6_58ac4df2-1383-4bda-bf96-d7c33a9b195a/extractor/0.log" Jul 09 18:32:08.172489 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:08.172456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-748bdf6488-c7wd8_af54eb50-a386-46af-95d1-46f298348e48/manager/0.log" Jul 09 18:32:08.194640 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:08.194611 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-kp7m2_efc810e4-b3a2-4c48-a090-58f868627e06/manager/0.log" Jul 09 18:32:08.225096 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:08.225068 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-vf65s_9f4340ed-e634-4bc3-91b5-0c4e5fbe9de6/server/0.log" Jul 09 18:32:08.517510 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:08.517425 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-pd7pk_4b149659-9030-48e9-a213-1c8de5e5aceb/seaweedfs-tls-custom/0.log" Jul 09 18:32:08.543641 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:08.543619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-2f8gj_369f0124-8e37-41b6-8082-4113f564757f/seaweedfs-tls-serving/0.log" Jul 09 18:32:09.272750 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:09.272721 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sbwk5/perf-node-gather-daemonset-pkfzs" Jul 09 18:32:13.076042 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:13.075981 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-j4wk6_08755ce9-363a-4ed0-b123-faded1854a48/migrator/0.log" Jul 09 18:32:13.114007 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:13.113931 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-j4wk6_08755ce9-363a-4ed0-b123-faded1854a48/graceful-termination/0.log" Jul 09 18:32:13.552782 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:13.552753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pd4tl_7e4ee00e-9f1a-4083-95c8-601ce2c001f8/kube-storage-version-migrator-operator/1.log" Jul 09 18:32:13.553620 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:13.553603 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pd4tl_7e4ee00e-9f1a-4083-95c8-601ce2c001f8/kube-storage-version-migrator-operator/0.log" Jul 09 18:32:14.984890 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:14.984859 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/kube-multus-additional-cni-plugins/0.log" Jul 09 18:32:15.022085 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.022057 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/egress-router-binary-copy/0.log" Jul 09 18:32:15.049510 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.049479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/cni-plugins/0.log" Jul 09 18:32:15.076771 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.076728 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/bond-cni-plugin/0.log" Jul 09 18:32:15.106562 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.106536 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/routeoverride-cni/0.log" Jul 09 18:32:15.133906 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.133879 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/whereabouts-cni-bincopy/0.log" Jul 09 18:32:15.164217 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.164182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjtn_a7935b3f-a980-4103-bd54-e85a0510cd7f/whereabouts-cni/0.log" Jul 09 18:32:15.229848 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.229819 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-spsr7_0fe86208-9ae2-477c-b7f4-7d75baff8104/kube-multus/0.log" Jul 09 18:32:15.322439 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.322365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vgxd7_b1ee9cce-c279-478f-8ca0-dd6bae1ad007/network-metrics-daemon/0.log" Jul 09 18:32:15.348073 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:15.348022 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vgxd7_b1ee9cce-c279-478f-8ca0-dd6bae1ad007/kube-rbac-proxy/0.log" Jul 09 18:32:16.384465 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.384436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-controller/0.log" Jul 09 18:32:16.404831 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.404802 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/0.log" Jul 09 18:32:16.404999 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.404878 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovn-acl-logging/1.log" Jul 09 18:32:16.423374 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.423350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/kube-rbac-proxy-node/0.log" Jul 09 18:32:16.450002 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.449975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 18:32:16.470548 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.470521 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/northd/0.log" Jul 09 18:32:16.493717 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.493686 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/nbdb/0.log" Jul 09 18:32:16.515374 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.515347 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/sbdb/0.log" Jul 09 18:32:16.557408 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:16.557377 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqvlv_932dba37-1789-4a2c-9a3b-91cdf3156045/ovnkube-controller/0.log" Jul 09 18:32:18.153890 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:18.153863 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-mmn59_605e9e1a-6f24-4886-846b-d3defa7aa69a/check-endpoints/0.log" Jul 09 18:32:18.230067 ip-10-0-143-68 kubenswrapper[2564]: I0709 18:32:18.230021 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kjwj7_ba307fab-e4c6-4429-a6e0-feb3f2b474e2/network-check-target-container/0.log"